[Betacluster-alerts] ** PROBLEM alert - deployment-fluorine02/Free space - all mounts is WARNING **
Notification Type: PROBLEM Service: Free space - all mounts Host: deployment-fluorine02 Address: 172.16.5.71 State: WARNING Date/Time: Sat 16 Mar 06:04:44 UTC 2019 Notes URLs: Additional Info: WARNING: deployment-prep.deployment-fluorine02.diskspace._srv.byte_percentfree (<80.00%) ___ Betacluster-alerts mailing list Betacluster-alerts@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/betacluster-alerts
[Betacluster-alerts] beta-scap-eqiad - Build # 241590 - Fixed!
beta-scap-eqiad - Build # 241590 - Fixed: Check console output at https://integration.wikimedia.org/ci/job/beta-scap-eqiad/241590/ to view the results.___ Betacluster-alerts mailing list Betacluster-alerts@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/betacluster-alerts
[Betacluster-alerts] beta-scap-eqiad - Build # 241589 - Failure!
beta-scap-eqiad - Build # 241589 - Failure: Check console output at https://integration.wikimedia.org/ci/job/beta-scap-eqiad/241589/ to view the results.___ Betacluster-alerts mailing list Betacluster-alerts@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/betacluster-alerts
[Betacluster-alerts] ** RECOVERY alert - deployment-deploy01/Free space - all mounts is OK **
Notification Type: RECOVERY Service: Free space - all mounts Host: deployment-deploy01 Address: 172.16.4.18 State: OK Date/Time: Sat 16 Mar 05:32:09 UTC 2019 Notes URLs: Additional Info: OK: All targets OK ___ Betacluster-alerts mailing list Betacluster-alerts@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/betacluster-alerts
[Betacluster-alerts] ** PROBLEM alert - deployment-deploy01/Free space - all mounts is WARNING **
Notification Type: PROBLEM Service: Free space - all mounts Host: deployment-deploy01 Address: 172.16.4.18 State: WARNING Date/Time: Sat 16 Mar 05:12:10 UTC 2019 Notes URLs: Additional Info: WARNING: deployment-prep.deployment-deploy01.diskspace.root.byte_percentfree (<11.11%) ___ Betacluster-alerts mailing list Betacluster-alerts@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/betacluster-alerts
[Betacluster-alerts] beta-scap-eqiad - Build # 241581 - Fixed!
beta-scap-eqiad - Build # 241581 - Fixed: Check console output at https://integration.wikimedia.org/ci/job/beta-scap-eqiad/241581/ to view the results.___ Betacluster-alerts mailing list Betacluster-alerts@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/betacluster-alerts
[Betacluster-alerts] beta-scap-eqiad - Build # 241580 - Failure!
beta-scap-eqiad - Build # 241580 - Failure: Check console output at https://integration.wikimedia.org/ci/job/beta-scap-eqiad/241580/ to view the results.___ Betacluster-alerts mailing list Betacluster-alerts@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/betacluster-alerts
[Betacluster-alerts] beta-scap-eqiad - Build # 241577 - Fixed!
beta-scap-eqiad - Build # 241577 - Fixed: Check console output at https://integration.wikimedia.org/ci/job/beta-scap-eqiad/241577/ to view the results.___ Betacluster-alerts mailing list Betacluster-alerts@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/betacluster-alerts
[Betacluster-alerts] beta-scap-eqiad - Build # 241576 - Failure!
beta-scap-eqiad - Build # 241576 - Failure: Check console output at https://integration.wikimedia.org/ci/job/beta-scap-eqiad/241576/ to view the results.___ Betacluster-alerts mailing list Betacluster-alerts@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/betacluster-alerts
[Betacluster-alerts] ** PROBLEM alert - deployment-mediawiki-09/Puppet staleness is CRITICAL **
Notification Type: PROBLEM Service: Puppet staleness Host: deployment-mediawiki-09 Address: 172.16.4.106 State: CRITICAL Date/Time: Sat 16 Mar 03:02:20 UTC 2019 Notes URLs: Additional Info: CRITICAL: 55.56% of data above the critical threshold [43200.0] ___ Betacluster-alerts mailing list Betacluster-alerts@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/betacluster-alerts
[Betacluster-alerts] ** PROBLEM alert - deployment-restbase02/Puppet staleness is CRITICAL **
Notification Type: PROBLEM Service: Puppet staleness Host: deployment-restbase02 Address: 172.16.5.82 State: CRITICAL Date/Time: Sat 16 Mar 02:55:06 UTC 2019 Notes URLs: Additional Info: CRITICAL: 11.11% of data above the critical threshold [43200.0] ___ Betacluster-alerts mailing list Betacluster-alerts@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/betacluster-alerts
[Betacluster-alerts] beta-scap-eqiad - Build # 241573 - Fixed!
beta-scap-eqiad - Build # 241573 - Fixed: Check console output at https://integration.wikimedia.org/ci/job/beta-scap-eqiad/241573/ to view the results.___ Betacluster-alerts mailing list Betacluster-alerts@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/betacluster-alerts
[Betacluster-alerts] beta-scap-eqiad - Build # 241572 - Failure!
beta-scap-eqiad - Build # 241572 - Failure: Check console output at https://integration.wikimedia.org/ci/job/beta-scap-eqiad/241572/ to view the results.___ Betacluster-alerts mailing list Betacluster-alerts@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/betacluster-alerts
[Betacluster-alerts] beta-scap-eqiad - Build # 241560 - Fixed!
beta-scap-eqiad - Build # 241560 - Fixed: Check console output at https://integration.wikimedia.org/ci/job/beta-scap-eqiad/241560/ to view the results.___ Betacluster-alerts mailing list Betacluster-alerts@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/betacluster-alerts
[Betacluster-alerts] beta-scap-eqiad - Build # 241559 - Failure!
beta-scap-eqiad - Build # 241559 - Failure: Check console output at https://integration.wikimedia.org/ci/job/beta-scap-eqiad/241559/ to view the results.___ Betacluster-alerts mailing list Betacluster-alerts@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/betacluster-alerts
[Betacluster-alerts] beta-scap-eqiad - Build # 241556 - Fixed!
beta-scap-eqiad - Build # 241556 - Fixed: Check console output at https://integration.wikimedia.org/ci/job/beta-scap-eqiad/241556/ to view the results.___ Betacluster-alerts mailing list Betacluster-alerts@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/betacluster-alerts
[Betacluster-alerts] beta-scap-eqiad - Build # 241555 - Failure!
beta-scap-eqiad - Build # 241555 - Failure: Check console output at https://integration.wikimedia.org/ci/job/beta-scap-eqiad/241555/ to view the results.___ Betacluster-alerts mailing list Betacluster-alerts@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/betacluster-alerts
[Betacluster-alerts] ** RECOVERY alert - deployment-ms-be03/Puppet errors is OK **
Notification Type: RECOVERY Service: Puppet errors Host: deployment-ms-be03 Address: 172.16.5.51 State: OK Date/Time: Fri 15 Mar 23:25:09 UTC 2019 Notes URLs: Additional Info: OK: Less than 1.00% above the threshold [2.0] ___ Betacluster-alerts mailing list Betacluster-alerts@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/betacluster-alerts
[Betacluster-alerts] ** RECOVERY alert - deployment-ircd/Puppet errors is OK **
Notification Type: RECOVERY Service: Puppet errors Host: deployment-ircd Address: 172.16.5.68 State: OK Date/Time: Fri 15 Mar 23:24:35 UTC 2019 Notes URLs: Additional Info: OK: Less than 1.00% above the threshold [2.0] ___ Betacluster-alerts mailing list Betacluster-alerts@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/betacluster-alerts
[Betacluster-alerts] ** RECOVERY alert - deployment-memc05/Puppet errors is OK **
Notification Type: RECOVERY Service: Puppet errors Host: deployment-memc05 Address: 172.16.5.17 State: OK Date/Time: Fri 15 Mar 23:23:46 UTC 2019 Notes URLs: Additional Info: OK: Less than 1.00% above the threshold [2.0] ___ Betacluster-alerts mailing list Betacluster-alerts@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/betacluster-alerts
[Betacluster-alerts] ** RECOVERY alert - deployment-zookeeper02/Puppet errors is OK **
Notification Type: RECOVERY Service: Puppet errors Host: deployment-zookeeper02 Address: 172.16.5.55 State: OK Date/Time: Fri 15 Mar 23:22:44 UTC 2019 Notes URLs: Additional Info: OK: Less than 1.00% above the threshold [2.0] ___ Betacluster-alerts mailing list Betacluster-alerts@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/betacluster-alerts
[Betacluster-alerts] ** RECOVERY alert - deployment-sentry01/Puppet errors is OK **
Notification Type: RECOVERY Service: Puppet errors Host: deployment-sentry01 Address: 172.16.5.16 State: OK Date/Time: Fri 15 Mar 23:21:15 UTC 2019 Notes URLs: Additional Info: OK: Less than 1.00% above the threshold [2.0] ___ Betacluster-alerts mailing list Betacluster-alerts@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/betacluster-alerts
[Betacluster-alerts] ** RECOVERY alert - deployment-maps03/Puppet errors is OK **
Notification Type: RECOVERY Service: Puppet errors Host: deployment-maps03 Address: 172.16.4.113 State: OK Date/Time: Fri 15 Mar 23:20:40 UTC 2019 Notes URLs: Additional Info: OK: Less than 1.00% above the threshold [2.0] ___ Betacluster-alerts mailing list Betacluster-alerts@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/betacluster-alerts
[Betacluster-alerts] ** RECOVERY alert - deployment-imagescaler01/Puppet errors is OK **
Notification Type: RECOVERY Service: Puppet errors Host: deployment-imagescaler01 Address: 172.16.5.80 State: OK Date/Time: Fri 15 Mar 23:15:08 UTC 2019 Notes URLs: Additional Info: OK: Less than 1.00% above the threshold [2.0] ___ Betacluster-alerts mailing list Betacluster-alerts@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/betacluster-alerts
[Betacluster-alerts] ** RECOVERY alert - deployment-mwmaint01/Puppet errors is OK **
Notification Type: RECOVERY Service: Puppet errors Host: deployment-mwmaint01 Address: 172.16.4.16 State: OK Date/Time: Fri 15 Mar 22:01:00 UTC 2019 Notes URLs: Additional Info: OK: Less than 1.00% above the threshold [2.0] ___ Betacluster-alerts mailing list Betacluster-alerts@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/betacluster-alerts
[Betacluster-alerts] ** RECOVERY alert - deployment-jobrunner03/Puppet errors is OK **
Notification Type: RECOVERY Service: Puppet errors Host: deployment-jobrunner03 Address: 172.16.4.98 State: OK Date/Time: Fri 15 Mar 21:59:56 UTC 2019 Notes URLs: Additional Info: OK: Less than 1.00% above the threshold [2.0] ___ Betacluster-alerts mailing list Betacluster-alerts@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/betacluster-alerts
[Betacluster-alerts] beta-scap-eqiad - Build # 241547 - Fixed!
beta-scap-eqiad - Build # 241547 - Fixed: Check console output at https://integration.wikimedia.org/ci/job/beta-scap-eqiad/241547/ to view the results.___ Betacluster-alerts mailing list Betacluster-alerts@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/betacluster-alerts
[Betacluster-alerts] beta-scap-eqiad - Build # 241546 - Failure!
beta-scap-eqiad - Build # 241546 - Failure: Check console output at https://integration.wikimedia.org/ci/job/beta-scap-eqiad/241546/ to view the results.___ Betacluster-alerts mailing list Betacluster-alerts@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/betacluster-alerts
[Betacluster-alerts] ** PROBLEM alert - deployment-ircd/Puppet errors is WARNING **
Notification Type: PROBLEM Service: Puppet errors Host: deployment-ircd Address: 172.16.5.68 State: WARNING Date/Time: Fri 15 Mar 21:29:33 UTC 2019 Notes URLs: Additional Info: WARNING: 9.20% of data above the warning threshold [2.0] ___ Betacluster-alerts mailing list Betacluster-alerts@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/betacluster-alerts
[Betacluster-alerts] ** PROBLEM alert - deployment-memc05/Puppet errors is WARNING **
Notification Type: PROBLEM Service: Puppet errors Host: deployment-memc05 Address: 172.16.5.17 State: WARNING Date/Time: Fri 15 Mar 21:28:45 UTC 2019 Notes URLs: Additional Info: WARNING: 10.00% of data above the warning threshold [2.0] ___ Betacluster-alerts mailing list Betacluster-alerts@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/betacluster-alerts
[Betacluster-alerts] ** PROBLEM alert - deployment-zookeeper02/Puppet errors is WARNING **
Notification Type: PROBLEM Service: Puppet errors Host: deployment-zookeeper02 Address: 172.16.5.55 State: WARNING Date/Time: Fri 15 Mar 21:27:42 UTC 2019 Notes URLs: Additional Info: WARNING: 11.11% of data above the warning threshold [2.0] ___ Betacluster-alerts mailing list Betacluster-alerts@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/betacluster-alerts
[Betacluster-alerts] ** PROBLEM alert - deployment-ms-be03/Puppet errors is WARNING **
Notification Type: PROBLEM Service: Puppet errors Host: deployment-ms-be03 Address: 172.16.5.51 State: WARNING Date/Time: Fri 15 Mar 21:25:08 UTC 2019 Notes URLs: Additional Info: WARNING: 6.90% of data above the warning threshold [2.0] ___ Betacluster-alerts mailing list Betacluster-alerts@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/betacluster-alerts
[Betacluster-alerts] beta-scap-eqiad - Build # 241544 - Fixed!
beta-scap-eqiad - Build # 241544 - Fixed: Check console output at https://integration.wikimedia.org/ci/job/beta-scap-eqiad/241544/ to view the results.___ Betacluster-alerts mailing list Betacluster-alerts@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/betacluster-alerts
[Betacluster-alerts] ** PROBLEM alert - deployment-sentry01/Puppet errors is WARNING **
Notification Type: PROBLEM Service: Puppet errors Host: deployment-sentry01 Address: 172.16.5.16 State: WARNING Date/Time: Fri 15 Mar 21:21:15 UTC 2019 Notes URLs: Additional Info: WARNING: 6.74% of data above the warning threshold [2.0] ___ Betacluster-alerts mailing list Betacluster-alerts@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/betacluster-alerts
[Betacluster-alerts] ** PROBLEM alert - deployment-maps03/Puppet errors is WARNING **
Notification Type: PROBLEM Service: Puppet errors Host: deployment-maps03 Address: 172.16.4.113 State: WARNING Date/Time: Fri 15 Mar 21:20:41 UTC 2019 Notes URLs: Additional Info: WARNING: 7.78% of data above the warning threshold [2.0] ___ Betacluster-alerts mailing list Betacluster-alerts@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/betacluster-alerts
[Betacluster-alerts] ** PROBLEM alert - deployment-imagescaler01/Puppet errors is WARNING **
Notification Type: PROBLEM Service: Puppet errors Host: deployment-imagescaler01 Address: 172.16.5.80 State: WARNING Date/Time: Fri 15 Mar 21:20:09 UTC 2019 Notes URLs: Additional Info: WARNING: 7.87% of data above the warning threshold [2.0] ___ Betacluster-alerts mailing list Betacluster-alerts@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/betacluster-alerts
[Betacluster-alerts] beta-scap-eqiad - Build # 241543 - Failure!
beta-scap-eqiad - Build # 241543 - Failure: Check console output at https://integration.wikimedia.org/ci/job/beta-scap-eqiad/241543/ to view the results.___ Betacluster-alerts mailing list Betacluster-alerts@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/betacluster-alerts
[Betacluster-alerts] beta-scap-eqiad - Build # 241541 - Fixed!
beta-scap-eqiad - Build # 241541 - Fixed: Check console output at https://integration.wikimedia.org/ci/job/beta-scap-eqiad/241541/ to view the results.___ Betacluster-alerts mailing list Betacluster-alerts@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/betacluster-alerts
[Betacluster-alerts] beta-scap-eqiad - Build # 241540 - Failure!
beta-scap-eqiad - Build # 241540 - Failure: Check console output at https://integration.wikimedia.org/ci/job/beta-scap-eqiad/241540/ to view the results.___ Betacluster-alerts mailing list Betacluster-alerts@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/betacluster-alerts
[Betacluster-alerts] beta-scap-eqiad - Build # 241539 - Fixed!
beta-scap-eqiad - Build # 241539 - Fixed: Check console output at https://integration.wikimedia.org/ci/job/beta-scap-eqiad/241539/ to view the results.___ Betacluster-alerts mailing list Betacluster-alerts@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/betacluster-alerts
[Betacluster-alerts] beta-scap-eqiad - Build # 241538 - Failure!
beta-scap-eqiad - Build # 241538 - Failure: Check console output at https://integration.wikimedia.org/ci/job/beta-scap-eqiad/241538/ to view the results.___ Betacluster-alerts mailing list Betacluster-alerts@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/betacluster-alerts
[Betacluster-alerts] ** PROBLEM alert - deployment-jobrunner03/Puppet errors is CRITICAL **
Notification Type: PROBLEM Service: Puppet errors Host: deployment-jobrunner03 Address: 172.16.4.98 State: CRITICAL Date/Time: Fri 15 Mar 20:04:59 UTC 2019 Notes URLs: Additional Info: CRITICAL: 8.99% of data above the critical threshold [3.0] ___ Betacluster-alerts mailing list Betacluster-alerts@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/betacluster-alerts
[Betacluster-alerts] ** PROBLEM alert - deployment-mwmaint01/Puppet errors is CRITICAL **
Notification Type: PROBLEM Service: Puppet errors Host: deployment-mwmaint01 Address: 172.16.4.16 State: CRITICAL Date/Time: Fri 15 Mar 20:01:01 UTC 2019 Notes URLs: Additional Info: CRITICAL: 6.67% of data above the critical threshold [3.0] ___ Betacluster-alerts mailing list Betacluster-alerts@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/betacluster-alerts
[Betacluster-alerts] beta-scap-eqiad - Build # 241535 - Fixed!
beta-scap-eqiad - Build # 241535 - Fixed: Check console output at https://integration.wikimedia.org/ci/job/beta-scap-eqiad/241535/ to view the results.___ Betacluster-alerts mailing list Betacluster-alerts@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/betacluster-alerts
[Betacluster-alerts] beta-scap-eqiad - Build # 241534 - Still Failing!
beta-scap-eqiad - Build # 241534 - Still Failing: Check console output at https://integration.wikimedia.org/ci/job/beta-scap-eqiad/241534/ to view the results.___ Betacluster-alerts mailing list Betacluster-alerts@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/betacluster-alerts
[Betacluster-alerts] beta-scap-eqiad - Build # 241533 - Failure!
beta-scap-eqiad - Build # 241533 - Failure: Check console output at https://integration.wikimedia.org/ci/job/beta-scap-eqiad/241533/ to view the results.___ Betacluster-alerts mailing list Betacluster-alerts@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/betacluster-alerts
[Betacluster-alerts] ** RECOVERY alert - deployment-restbase01/Puppet staleness is OK **
Notification Type: RECOVERY Service: Puppet staleness Host: deployment-restbase01 Address: 172.16.5.26 State: OK Date/Time: Fri 15 Mar 19:22:07 UTC 2019 Notes URLs: Additional Info: OK: Less than 1.00% above the threshold [3600.0] ___ Betacluster-alerts mailing list Betacluster-alerts@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/betacluster-alerts
[Betacluster-alerts] beta-scap-eqiad - Build # 241531 - Fixed!
beta-scap-eqiad - Build # 241531 - Fixed: Check console output at https://integration.wikimedia.org/ci/job/beta-scap-eqiad/241531/ to view the results.___ Betacluster-alerts mailing list Betacluster-alerts@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/betacluster-alerts
[Betacluster-alerts] beta-scap-eqiad - Build # 241530 - Failure!
beta-scap-eqiad - Build # 241530 - Failure: Check console output at https://integration.wikimedia.org/ci/job/beta-scap-eqiad/241530/ to view the results.___ Betacluster-alerts mailing list Betacluster-alerts@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/betacluster-alerts
[Betacluster-alerts] beta-scap-eqiad - Build # 241523 - Fixed!
beta-scap-eqiad - Build # 241523 - Fixed: Check console output at https://integration.wikimedia.org/ci/job/beta-scap-eqiad/241523/ to view the results.___ Betacluster-alerts mailing list Betacluster-alerts@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/betacluster-alerts
[Betacluster-alerts] beta-scap-eqiad - Build # 241522 - Failure!
beta-scap-eqiad - Build # 241522 - Failure: Check console output at https://integration.wikimedia.org/ci/job/beta-scap-eqiad/241522/ to view the results.___ Betacluster-alerts mailing list Betacluster-alerts@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/betacluster-alerts
[Betacluster-alerts] beta-scap-eqiad - Build # 241519 - Aborted!
beta-scap-eqiad - Build # 241519 - Aborted: Check console output at https://integration.wikimedia.org/ci/job/beta-scap-eqiad/241519/ to view the results.___ Betacluster-alerts mailing list Betacluster-alerts@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/betacluster-alerts
[Betacluster-alerts] ** PROBLEM alert - deployment-mediawiki-09/Puppet staleness is WARNING **
Notification Type: PROBLEM Service: Puppet staleness Host: deployment-mediawiki-09 Address: 172.16.4.106 State: WARNING Date/Time: Fri 15 Mar 16:02:19 UTC 2019 Notes URLs: Additional Info: WARNING: 100.00% of data above the warning threshold [3600.0] ___ Betacluster-alerts mailing list Betacluster-alerts@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/betacluster-alerts
[Betacluster-alerts] ** PROBLEM alert - deployment-restbase01/Puppet staleness is WARNING **
Notification Type: PROBLEM Service: Puppet staleness Host: deployment-restbase01 Address: 172.16.5.26 State: WARNING Date/Time: Fri 15 Mar 16:02:07 UTC 2019 Notes URLs: Additional Info: WARNING: 77.78% of data above the warning threshold [3600.0] ___ Betacluster-alerts mailing list Betacluster-alerts@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/betacluster-alerts
[Betacluster-alerts] ** PROBLEM alert - deployment-restbase02/Puppet staleness is WARNING **
Notification Type: PROBLEM Service: Puppet staleness Host: deployment-restbase02 Address: 172.16.5.82 State: WARNING Date/Time: Fri 15 Mar 16:00:06 UTC 2019 Notes URLs: Additional Info: WARNING: 100.00% of data above the warning threshold [3600.0] ___ Betacluster-alerts mailing list Betacluster-alerts@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/betacluster-alerts
[Betacluster-alerts] ** RECOVERY alert - Graphite Labs/Mediawiki Error Rate is OK **
Notification Type: RECOVERY Service: Mediawiki Error Rate Host: Graphite Labs Address: graphite-labs.wikimedia.org State: OK Date/Time: Fri 15 Mar 15:50:06 UTC 2019 Notes URLs: Additional Info: OK: Less than 1.00% above the threshold [1.0] ___ Betacluster-alerts mailing list Betacluster-alerts@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/betacluster-alerts
[Betacluster-alerts] ** RECOVERY alert - deployment-mediawiki-07/Puppet errors is OK **
Notification Type: RECOVERY Service: Puppet errors Host: deployment-mediawiki-07 Address: 172.16.4.119 State: OK Date/Time: Fri 15 Mar 15:36:40 UTC 2019 Notes URLs: Additional Info: OK: Less than 1.00% above the threshold [2.0] ___ Betacluster-alerts mailing list Betacluster-alerts@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/betacluster-alerts
[Betacluster-alerts] ** RECOVERY alert - deployment-deploy02/Puppet errors is OK **
Notification Type: RECOVERY Service: Puppet errors Host: deployment-deploy02 Address: 172.16.4.19 State: OK Date/Time: Fri 15 Mar 15:35:38 UTC 2019 Notes URLs: Additional Info: OK: Less than 1.00% above the threshold [2.0] ___ Betacluster-alerts mailing list Betacluster-alerts@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/betacluster-alerts
[Betacluster-alerts] ** PROBLEM alert - Graphite Labs/Mediawiki Error Rate is WARNING **
Notification Type: PROBLEM Service: Mediawiki Error Rate Host: Graphite Labs Address: graphite-labs.wikimedia.org State: WARNING Date/Time: Fri 15 Mar 15:35:05 UTC 2019 Notes URLs: Additional Info: WARNING: 20.00% of data above the warning threshold [1.0] ___ Betacluster-alerts mailing list Betacluster-alerts@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/betacluster-alerts
[Betacluster-alerts] ** PROBLEM alert - deployment-deploy02/Puppet errors is CRITICAL **
Notification Type: PROBLEM Service: Puppet errors Host: deployment-deploy02 Address: 172.16.4.19 State: CRITICAL Date/Time: Fri 15 Mar 13:40:37 UTC 2019 Notes URLs: Additional Info: CRITICAL: 10.00% of data above the critical threshold [3.0] ___ Betacluster-alerts mailing list Betacluster-alerts@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/betacluster-alerts
[Betacluster-alerts] ** PROBLEM alert - deployment-db03/Puppet errors is CRITICAL **
Notification Type: PROBLEM Service: Puppet errors Host: deployment-db03 Address: 172.16.5.23 State: CRITICAL Date/Time: Fri 15 Mar 13:37:08 UTC 2019 Notes URLs: Additional Info: CRITICAL: 6.74% of data above the critical threshold [3.0] ___ Betacluster-alerts mailing list Betacluster-alerts@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/betacluster-alerts
[Betacluster-alerts] ** PROBLEM alert - deployment-mediawiki-07/Puppet errors is CRITICAL **
Notification Type: PROBLEM Service: Puppet errors Host: deployment-mediawiki-07 Address: 172.16.4.119 State: CRITICAL Date/Time: Fri 15 Mar 13:36:38 UTC 2019 Notes URLs: Additional Info: CRITICAL: 8.89% of data above the critical threshold [3.0] ___ Betacluster-alerts mailing list Betacluster-alerts@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/betacluster-alerts
[Betacluster-alerts] beta-scap-eqiad - Build # 241501 - Fixed!
beta-scap-eqiad - Build # 241501 - Fixed: Check console output at https://integration.wikimedia.org/ci/job/beta-scap-eqiad/241501/ to view the results.___ Betacluster-alerts mailing list Betacluster-alerts@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/betacluster-alerts
[Betacluster-alerts] beta-scap-eqiad - Build # 241500 - Failure!
beta-scap-eqiad - Build # 241500 - Failure: Check console output at https://integration.wikimedia.org/ci/job/beta-scap-eqiad/241500/ to view the results.___ Betacluster-alerts mailing list Betacluster-alerts@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/betacluster-alerts
[Betacluster-alerts] ** RECOVERY alert - Generic Beta Cluster/English Wikipedia Main page is OK **
Notification Type: RECOVERY Service: English Wikipedia Main page Host: Generic Beta Cluster Address: en.wikipedia.beta.wmflabs.org State: OK Date/Time: Fri 15 Mar 09:00:13 UTC 2019 Notes URLs: Additional Info: HTTP OK: HTTP/1.1 200 OK - 48807 bytes in 0.766 second response time ___ Betacluster-alerts mailing list Betacluster-alerts@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/betacluster-alerts
[Betacluster-alerts] ** RECOVERY alert - deployment-mediawiki-07/App Server Main HTTP Response is OK **
Notification Type: RECOVERY Service: App Server Main HTTP Response Host: deployment-mediawiki-07 Address: 172.16.4.119 State: OK Date/Time: Fri 15 Mar 08:59:33 UTC 2019 Notes URLs: Additional Info: HTTP OK: HTTP/1.1 200 OK - 48181 bytes in 1.216 second response time ___ Betacluster-alerts mailing list Betacluster-alerts@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/betacluster-alerts
[Betacluster-alerts] ** RECOVERY alert - Generic Beta Cluster/English Wikipedia Mobile Main page is OK **
Notification Type: RECOVERY Service: English Wikipedia Mobile Main page Host: Generic Beta Cluster Address: en.wikipedia.beta.wmflabs.org State: OK Date/Time: Fri 15 Mar 08:57:49 UTC 2019 Notes URLs: Additional Info: HTTP OK: HTTP/1.1 200 OK - 36919 bytes in 0.905 second response time ___ Betacluster-alerts mailing list Betacluster-alerts@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/betacluster-alerts
[Betacluster-alerts] ** PROBLEM alert - Generic Beta Cluster/English Wikipedia Main page is CRITICAL **
Notification Type: PROBLEM Service: English Wikipedia Main page Host: Generic Beta Cluster Address: en.wikipedia.beta.wmflabs.org State: CRITICAL Date/Time: Fri 15 Mar 08:55:14 UTC 2019 Notes URLs: Additional Info: HTTP CRITICAL: HTTP/1.1 500 Internal Server Error - string 'Wikipedia' not found on 'https://en.wikipedia.beta.wmflabs.org:443/wiki/Main_Page?debug=true' - 2533 bytes in 0.035 second response time ___ Betacluster-alerts mailing list Betacluster-alerts@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/betacluster-alerts
[Betacluster-alerts] ** PROBLEM alert - deployment-mediawiki-07/App Server Main HTTP Response is CRITICAL **
Notification Type: PROBLEM Service: App Server Main HTTP Response Host: deployment-mediawiki-07 Address: 172.16.4.119 State: CRITICAL Date/Time: Fri 15 Mar 08:54:34 UTC 2019 Notes URLs: Additional Info: HTTP CRITICAL: HTTP/1.1 500 Internal Server Error - string 'Wikipedia' not found on 'http://en.wikipedia.beta.wmflabs.org:80/wiki/Main_Page?debug=true' - 1904 bytes in 0.019 second response time ___ Betacluster-alerts mailing list Betacluster-alerts@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/betacluster-alerts
[Betacluster-alerts] ** PROBLEM alert - Generic Beta Cluster/English Wikipedia Mobile Main page is CRITICAL **
Notification Type: PROBLEM Service: English Wikipedia Mobile Main page Host: Generic Beta Cluster Address: en.wikipedia.beta.wmflabs.org State: CRITICAL Date/Time: Fri 15 Mar 08:52:49 UTC 2019 Notes URLs: Additional Info: HTTP CRITICAL: HTTP/1.1 500 Internal Server Error - string 'Wikipedia' not found on 'https://en.m.wikipedia.beta.wmflabs.org:443/wiki/Main_Page?debug=true' - 2534 bytes in 0.035 second response time ___ Betacluster-alerts mailing list Betacluster-alerts@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/betacluster-alerts
[Betacluster-alerts] selenium-daily-beta-MediaWiki - Build # 207 - Failure!
FAILURE: selenium-daily-beta-MediaWiki Build #207 (Fri, 15 Mar 2019 07:40:00 +) Test Result 1 failed, 0 skipped Failed Tests Test NameDurationAge chrome.Page2.should be editable @daily46.7 sec1 All Tests PackageDurationFailSkipTotal chrome16 sec104 ___ Betacluster-alerts mailing list Betacluster-alerts@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/betacluster-alerts
[Betacluster-alerts] ** RECOVERY alert - deployment-fluorine02/Free space - all mounts is OK **
Notification Type: RECOVERY Service: Free space - all mounts Host: deployment-fluorine02 Address: 172.16.5.71 State: OK Date/Time: Fri 15 Mar 07:08:44 UTC 2019 Notes URLs: Additional Info: OK: All targets OK ___ Betacluster-alerts mailing list Betacluster-alerts@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/betacluster-alerts
