Hello everyone, I have run the alert-generator compliance test on Promscale and I am happy to report that *Promscale passed the test with a score of 100%*. Please find the logs of the alert generator attached to this message.
I will open a PR on prometheus/compliance <https://github.com/prometheus/compliance> shortly, with instructions on how to run the alert-generator compliance test on Promscale. Thank you Harkishen Promscale version: 0.11-alpha Promscale recent commit: link <https://github.com/timescale/promscale/commit/1c8efecc9b7a5d6fcf025dba58017e17f2194c2a> TimescaleDB image: ghcr.io/timescale/dev_promscale_extension:0.5.0-alpha-ts2-pg14 *Note:* The above image is a pre-release. While opening the PR in the prometheus/compliance repository, I will use the stable version which will be ready soon. *Links* Promscale: https://github.com/timescale/promscale Alert-generator compliance: https://github.com/prometheus/compliance/tree/main/alert_generator On Wednesday, March 2, 2022 at 2:12:02 PM UTC+5:30 ganes...@gmail.com wrote: > Hello Promscale team, > > I hope this email finds you well. > > As a part of Prometheus conformance program > <https://github.com/cncf/prometheus-conformance>, we had floated a doc on > "Prometheus Alert-Generator Compliance" many months ago and had finalized > the specification for that (see here > <https://github.com/prometheus/compliance/blob/main/alert_generator/specification.md> > ). > > The test suite to test the specification is now ready and instructions on > how to run the test suite are present here > <https://github.com/prometheus/compliance/blob/main/alert_generator/README.md> > . > > If you wish Promscale to be compliant with Prometheus Alert-Generator, > please test your software with the above test suite and report back the > results by replying to this thread (results being the entire log output of > the test run). > > If you do need any additional help from the test suite (for example > setting custom headers to some requests), please let me know and I will add > those abilities to the test suite. > > Going forward, we would like to automate this process. We ask you to add > your test-suite config template by opening a PR against > prometheus/compliance <https://github.com/prometheus/compliance/> and > create test-promscale.yaml in the alert_generator directory. See > test-.*.yaml files here > <https://github.com/prometheus/compliance/tree/main/alert_generator> for > example. Please also add instructions on how to set up as comments in the > same file. > > If you face issues in running the test suite or understanding any error > messages, I am happy to answer your queries. > > We plan to publish the results during the third week of May 2022 (during > KubeCon EU). > > Thanks, > Ganesh (codesome) > Prometheus team > -- You received this message because you are subscribed to the Google Groups "Prometheus Developers" group. To unsubscribe from this group and stop receiving emails from it, send an email to prometheus-developers+unsubscr...@googlegroups.com. To view this discussion on the web visit https://groups.google.com/d/msgid/prometheus-developers/76688030-65f3-4e1c-b1aa-b9f04965b01fn%40googlegroups.com.
harkishen@harkishen:~/compliance/alert_generator$ make run CONFIG=./test-promscale.yaml go build ./cmd/alert_generator_compliance_tester/ ./alert_generator_compliance_tester -config-file=./test-promscale.yaml level=info ts=2022-05-05T10:44:42.973Z caller=main.go:66 msg="Starting the test suite" level=info ts=2022-05-05T10:44:42.973Z caller=testsuite.go:188 component=testsuite msg="Starting the alert receiving server" port=8080 level=info ts=2022-05-05T10:44:42.974Z caller=testsuite.go:191 component=testsuite msg="Starting the remote writer" url=http://localhost:9201/write level=debug ts=2022-05-05T10:44:42.975Z caller=remote_write.go:147 component=remote_write msg="Remote writing" timestamp=2022-05-05T10:44:42.974Z total_series=10 level=info ts=2022-05-05T10:44:43.174Z caller=testsuite.go:195 component=testsuite msg="Starting test for a rule group" rulegroup=NewAlerts_OrderCheck description="(1) Rule that produces new alerts that go from pending->firing->inactive while already having active alerts. (2) A rule group having rules which are dependent on the ALERTS series from the rules above it in the same group. (3) Expansion of template in annotations only use the labels from the query result as source data even if those labels get overridden by the rules. They do not use the rules' additional labels." level=info ts=2022-05-05T10:44:43.175Z caller=testsuite.go:195 component=testsuite msg="Starting test for a rule group" rulegroup=PendingAndFiringAndResolved description="(1) Alert that goes from pending->firing->inactive. (2) pending alerts having changing annotation values (checked via API). (3) firing and inactive alerts being sent when they first went into those states. (4) firing alert being re-sent at expected intervals when the alert is active with changing annotation contents. (5) inactive alert being re-sent at expected intervals up to a certain time and not after that. (6) Alert that becomes active after having fired already and gone into inactive state where 'for' duration is non zero where inactive alert was still being sent." level=info ts=2022-05-05T10:44:43.176Z caller=testsuite.go:195 component=testsuite msg="Starting test for a rule group" rulegroup=PendingAndResolved_AlwaysInactive description="(1) Alert that goes from pending->inactive. (2) Rule that never becomes active (i.e. alerts in pending or firing).(3) Alert goes into inactive when there is no more data in pending." level=info ts=2022-05-05T10:44:43.176Z caller=testsuite.go:195 component=testsuite msg="Starting test for a rule group" rulegroup=ZeroFor_SmallFor description="(1) Alert that goes directly to firing state (skipping the pending state) because of zero for duration. (2) When the for duration is non-zero and less than the evaluation interval, firing alert must be sent after the second evaluation of the rule and not before. (3) Alert that becomes active after having fired already and gone into inactive state where 'for' duration is zero and the inactive alert was not being sent anymore.(4) Alert goes into inactive when there is no more data when in firing." level=info ts=2022-05-05T10:44:50.681Z caller=main.go:70 msg="Test will run until 2022-05-05T11:22:12Z approximately" time_remaining=37m22.292107358s level=debug ts=2022-05-05T10:44:57.977Z caller=remote_write.go:147 component=remote_write msg="Remote writing" timestamp=2022-05-05T10:44:57.974Z total_series=10 level=debug ts=2022-05-05T10:45:12.987Z caller=remote_write.go:147 component=remote_write msg="Remote writing" timestamp=2022-05-05T10:45:12.974Z total_series=10 level=debug ts=2022-05-05T10:45:27.977Z caller=remote_write.go:147 component=remote_write msg="Remote writing" timestamp=2022-05-05T10:45:27.974Z total_series=10 level=debug ts=2022-05-05T10:45:42.987Z caller=remote_write.go:147 component=remote_write msg="Remote writing" timestamp=2022-05-05T10:45:42.974Z total_series=10 level=debug ts=2022-05-05T10:45:57.982Z caller=remote_write.go:147 component=remote_write msg="Remote writing" timestamp=2022-05-05T10:45:57.974Z total_series=10 level=debug ts=2022-05-05T10:46:12.987Z caller=remote_write.go:147 component=remote_write msg="Remote writing" timestamp=2022-05-05T10:46:12.974Z total_series=10 level=debug ts=2022-05-05T10:46:27.981Z caller=remote_write.go:147 component=remote_write msg="Remote writing" timestamp=2022-05-05T10:46:27.974Z total_series=10 level=debug ts=2022-05-05T10:46:42.985Z caller=remote_write.go:147 component=remote_write msg="Remote writing" timestamp=2022-05-05T10:46:42.974Z total_series=10 level=debug ts=2022-05-05T10:46:57.981Z caller=remote_write.go:147 component=remote_write msg="Remote writing" timestamp=2022-05-05T10:46:57.974Z total_series=10 level=info ts=2022-05-05T10:46:59.813Z caller=server.go:102 component=alertsServer msg="Received alerts" num_alerts=1 level=debug ts=2022-05-05T10:47:12.977Z caller=remote_write.go:147 component=remote_write msg="Remote writing" timestamp=2022-05-05T10:47:12.974Z total_series=10 level=debug ts=2022-05-05T10:47:27.981Z caller=remote_write.go:147 component=remote_write msg="Remote writing" timestamp=2022-05-05T10:47:27.974Z total_series=10 level=info ts=2022-05-05T10:47:29.838Z caller=server.go:102 component=alertsServer msg="Received alerts" num_alerts=1 level=debug ts=2022-05-05T10:47:42.978Z caller=remote_write.go:147 component=remote_write msg="Remote writing" timestamp=2022-05-05T10:47:42.974Z total_series=10 level=debug ts=2022-05-05T10:47:57.981Z caller=remote_write.go:147 component=remote_write msg="Remote writing" timestamp=2022-05-05T10:47:57.974Z total_series=10 level=debug ts=2022-05-05T10:48:12.985Z caller=remote_write.go:147 component=remote_write msg="Remote writing" timestamp=2022-05-05T10:48:12.974Z total_series=10 level=debug ts=2022-05-05T10:48:27.977Z caller=remote_write.go:147 component=remote_write msg="Remote writing" timestamp=2022-05-05T10:48:27.974Z total_series=10 level=info ts=2022-05-05T10:48:29.806Z caller=server.go:102 component=alertsServer msg="Received alerts" num_alerts=1 level=debug ts=2022-05-05T10:48:42.976Z caller=remote_write.go:147 component=remote_write msg="Remote writing" timestamp=2022-05-05T10:48:42.974Z total_series=10 level=debug ts=2022-05-05T10:48:57.977Z caller=remote_write.go:147 component=remote_write msg="Remote writing" timestamp=2022-05-05T10:48:57.974Z total_series=10 level=info ts=2022-05-05T10:48:59.835Z caller=server.go:102 component=alertsServer msg="Received alerts" num_alerts=1 level=debug ts=2022-05-05T10:49:12.974Z caller=remote_write.go:147 component=remote_write msg="Remote writing" timestamp=2022-05-05T10:49:12.974Z total_series=10 level=debug ts=2022-05-05T10:49:27.977Z caller=remote_write.go:147 component=remote_write msg="Remote writing" timestamp=2022-05-05T10:49:27.974Z total_series=10 level=debug ts=2022-05-05T10:49:42.985Z caller=remote_write.go:147 component=remote_write msg="Remote writing" timestamp=2022-05-05T10:49:42.974Z total_series=8 level=debug ts=2022-05-05T10:49:57.977Z caller=remote_write.go:147 component=remote_write msg="Remote writing" timestamp=2022-05-05T10:49:57.974Z total_series=8 level=info ts=2022-05-05T10:49:59.811Z caller=server.go:102 component=alertsServer msg="Received alerts" num_alerts=1 level=info ts=2022-05-05T10:49:59.838Z caller=server.go:102 component=alertsServer msg="Received alerts" num_alerts=1 level=info ts=2022-05-05T10:50:09.130Z caller=server.go:102 component=alertsServer msg="Received alerts" num_alerts=1 level=debug ts=2022-05-05T10:50:12.977Z caller=remote_write.go:147 component=remote_write msg="Remote writing" timestamp=2022-05-05T10:50:12.974Z total_series=8 level=debug ts=2022-05-05T10:50:27.977Z caller=remote_write.go:147 component=remote_write msg="Remote writing" timestamp=2022-05-05T10:50:27.974Z total_series=8 level=debug ts=2022-05-05T10:50:42.986Z caller=remote_write.go:147 component=remote_write msg="Remote writing" timestamp=2022-05-05T10:50:42.974Z total_series=8 level=debug ts=2022-05-05T10:50:57.979Z caller=remote_write.go:147 component=remote_write msg="Remote writing" timestamp=2022-05-05T10:50:57.974Z total_series=8 level=debug ts=2022-05-05T10:51:12.986Z caller=remote_write.go:147 component=remote_write msg="Remote writing" timestamp=2022-05-05T10:51:12.974Z total_series=8 level=debug ts=2022-05-05T10:51:27.981Z caller=remote_write.go:147 component=remote_write msg="Remote writing" timestamp=2022-05-05T10:51:27.974Z total_series=8 level=info ts=2022-05-05T10:51:29.812Z caller=server.go:102 component=alertsServer msg="Received alerts" num_alerts=1 level=info ts=2022-05-05T10:51:29.815Z caller=server.go:102 component=alertsServer msg="Received alerts" num_alerts=1 level=info ts=2022-05-05T10:51:39.129Z caller=server.go:102 component=alertsServer msg="Received alerts" num_alerts=1 level=debug ts=2022-05-05T10:51:42.975Z caller=remote_write.go:147 component=remote_write msg="Remote writing" timestamp=2022-05-05T10:51:42.974Z total_series=8 level=debug ts=2022-05-05T10:51:57.976Z caller=remote_write.go:147 component=remote_write msg="Remote writing" timestamp=2022-05-05T10:51:57.974Z total_series=8 level=debug ts=2022-05-05T10:52:12.986Z caller=remote_write.go:147 component=remote_write msg="Remote writing" timestamp=2022-05-05T10:52:12.974Z total_series=8 level=debug ts=2022-05-05T10:52:27.978Z caller=remote_write.go:147 component=remote_write msg="Remote writing" timestamp=2022-05-05T10:52:27.974Z total_series=8 level=debug ts=2022-05-05T10:52:42.987Z caller=remote_write.go:147 component=remote_write msg="Remote writing" timestamp=2022-05-05T10:52:42.974Z total_series=8 level=info ts=2022-05-05T10:52:46.279Z caller=server.go:102 component=alertsServer msg="Received alerts" num_alerts=1 level=debug ts=2022-05-05T10:52:57.976Z caller=remote_write.go:147 component=remote_write msg="Remote writing" timestamp=2022-05-05T10:52:57.974Z total_series=8 level=info ts=2022-05-05T10:52:59.812Z caller=server.go:102 component=alertsServer msg="Received alerts" num_alerts=1 level=info ts=2022-05-05T10:52:59.815Z caller=server.go:102 component=alertsServer msg="Received alerts" num_alerts=1 level=info ts=2022-05-05T10:53:09.131Z caller=server.go:102 component=alertsServer msg="Received alerts" num_alerts=1 level=debug ts=2022-05-05T10:53:12.977Z caller=remote_write.go:147 component=remote_write msg="Remote writing" timestamp=2022-05-05T10:53:12.974Z total_series=8 level=debug ts=2022-05-05T10:53:27.981Z caller=remote_write.go:147 component=remote_write msg="Remote writing" timestamp=2022-05-05T10:53:27.974Z total_series=8 level=debug ts=2022-05-05T10:53:42.975Z caller=remote_write.go:147 component=remote_write msg="Remote writing" timestamp=2022-05-05T10:53:42.974Z total_series=8 level=debug ts=2022-05-05T10:53:57.976Z caller=remote_write.go:147 component=remote_write msg="Remote writing" timestamp=2022-05-05T10:53:57.974Z total_series=8 level=debug ts=2022-05-05T10:54:12.987Z caller=remote_write.go:147 component=remote_write msg="Remote writing" timestamp=2022-05-05T10:54:12.974Z total_series=8 level=info ts=2022-05-05T10:54:16.283Z caller=server.go:102 component=alertsServer msg="Received alerts" num_alerts=1 level=debug ts=2022-05-05T10:54:27.975Z caller=remote_write.go:147 component=remote_write msg="Remote writing" timestamp=2022-05-05T10:54:27.974Z total_series=8 level=info ts=2022-05-05T10:54:29.811Z caller=server.go:102 component=alertsServer msg="Received alerts" num_alerts=1 level=info ts=2022-05-05T10:54:29.815Z caller=server.go:102 component=alertsServer msg="Received alerts" num_alerts=1 level=info ts=2022-05-05T10:54:39.132Z caller=server.go:102 component=alertsServer msg="Received alerts" num_alerts=1 level=debug ts=2022-05-05T10:54:42.977Z caller=remote_write.go:147 component=remote_write msg="Remote writing" timestamp=2022-05-05T10:54:42.974Z total_series=8 level=debug ts=2022-05-05T10:54:57.981Z caller=remote_write.go:147 component=remote_write msg="Remote writing" timestamp=2022-05-05T10:54:57.974Z total_series=8 level=debug ts=2022-05-05T10:55:12.985Z caller=remote_write.go:147 component=remote_write msg="Remote writing" timestamp=2022-05-05T10:55:12.974Z total_series=8 level=debug ts=2022-05-05T10:55:27.977Z caller=remote_write.go:147 component=remote_write msg="Remote writing" timestamp=2022-05-05T10:55:27.974Z total_series=8 level=debug ts=2022-05-05T10:55:42.989Z caller=remote_write.go:147 component=remote_write msg="Remote writing" timestamp=2022-05-05T10:55:42.974Z total_series=8 level=info ts=2022-05-05T10:55:46.286Z caller=server.go:102 component=alertsServer msg="Received alerts" num_alerts=1 level=debug ts=2022-05-05T10:55:57.975Z caller=remote_write.go:147 component=remote_write msg="Remote writing" timestamp=2022-05-05T10:55:57.974Z total_series=8 level=info ts=2022-05-05T10:55:59.811Z caller=server.go:102 component=alertsServer msg="Received alerts" num_alerts=1 level=info ts=2022-05-05T10:55:59.814Z caller=server.go:102 component=alertsServer msg="Received alerts" num_alerts=1 level=info ts=2022-05-05T10:56:09.131Z caller=server.go:102 component=alertsServer msg="Received alerts" num_alerts=2 level=info ts=2022-05-05T10:56:09.165Z caller=server.go:102 component=alertsServer msg="Received alerts" num_alerts=1 level=debug ts=2022-05-05T10:56:12.977Z caller=remote_write.go:147 component=remote_write msg="Remote writing" timestamp=2022-05-05T10:56:12.974Z total_series=8 level=debug ts=2022-05-05T10:56:27.981Z caller=remote_write.go:147 component=remote_write msg="Remote writing" timestamp=2022-05-05T10:56:27.974Z total_series=8 level=debug ts=2022-05-05T10:56:42.985Z caller=remote_write.go:147 component=remote_write msg="Remote writing" timestamp=2022-05-05T10:56:42.974Z total_series=8 level=debug ts=2022-05-05T10:56:57.980Z caller=remote_write.go:147 component=remote_write msg="Remote writing" timestamp=2022-05-05T10:56:57.974Z total_series=8 level=debug ts=2022-05-05T10:57:12.986Z caller=remote_write.go:147 component=remote_write msg="Remote writing" timestamp=2022-05-05T10:57:12.974Z total_series=8 level=info ts=2022-05-05T10:57:16.284Z caller=server.go:102 component=alertsServer msg="Received alerts" num_alerts=1 level=debug ts=2022-05-05T10:57:27.976Z caller=remote_write.go:147 component=remote_write msg="Remote writing" timestamp=2022-05-05T10:57:27.974Z total_series=8 level=info ts=2022-05-05T10:57:29.811Z caller=server.go:102 component=alertsServer msg="Received alerts" num_alerts=1 level=info ts=2022-05-05T10:57:29.815Z caller=server.go:102 component=alertsServer msg="Received alerts" num_alerts=1 level=info ts=2022-05-05T10:57:39.131Z caller=server.go:102 component=alertsServer msg="Received alerts" num_alerts=2 level=info ts=2022-05-05T10:57:39.170Z caller=server.go:102 component=alertsServer msg="Received alerts" num_alerts=1 level=debug ts=2022-05-05T10:57:42.977Z caller=remote_write.go:147 component=remote_write msg="Remote writing" timestamp=2022-05-05T10:57:42.974Z total_series=8 level=debug ts=2022-05-05T10:57:57.980Z caller=remote_write.go:147 component=remote_write msg="Remote writing" timestamp=2022-05-05T10:57:57.974Z total_series=8 level=debug ts=2022-05-05T10:58:12.986Z caller=remote_write.go:147 component=remote_write msg="Remote writing" timestamp=2022-05-05T10:58:12.974Z total_series=8 level=debug ts=2022-05-05T10:58:27.981Z caller=remote_write.go:147 component=remote_write msg="Remote writing" timestamp=2022-05-05T10:58:27.974Z total_series=8 level=debug ts=2022-05-05T10:58:42.986Z caller=remote_write.go:147 component=remote_write msg="Remote writing" timestamp=2022-05-05T10:58:42.974Z total_series=8 level=info ts=2022-05-05T10:58:46.286Z caller=server.go:102 component=alertsServer msg="Received alerts" num_alerts=1 level=debug ts=2022-05-05T10:58:57.975Z caller=remote_write.go:147 component=remote_write msg="Remote writing" timestamp=2022-05-05T10:58:57.974Z total_series=8 level=info ts=2022-05-05T10:58:59.811Z caller=server.go:102 component=alertsServer msg="Received alerts" num_alerts=1 level=info ts=2022-05-05T10:58:59.815Z caller=server.go:102 component=alertsServer msg="Received alerts" num_alerts=1 level=info ts=2022-05-05T10:59:09.132Z caller=server.go:102 component=alertsServer msg="Received alerts" num_alerts=2 level=info ts=2022-05-05T10:59:09.159Z caller=server.go:102 component=alertsServer msg="Received alerts" num_alerts=1 level=debug ts=2022-05-05T10:59:12.977Z caller=remote_write.go:147 component=remote_write msg="Remote writing" timestamp=2022-05-05T10:59:12.974Z total_series=8 level=debug ts=2022-05-05T10:59:27.977Z caller=remote_write.go:147 component=remote_write msg="Remote writing" timestamp=2022-05-05T10:59:27.974Z total_series=8 level=debug ts=2022-05-05T10:59:42.985Z caller=remote_write.go:147 component=remote_write msg="Remote writing" timestamp=2022-05-05T10:59:42.974Z total_series=8 level=info ts=2022-05-05T10:59:50.773Z caller=testsuite.go:384 component=testsuite msg="Test finished successfully for a rule group" rulegroup=PendingAndResolved_AlwaysInactive level=debug ts=2022-05-05T10:59:57.982Z caller=remote_write.go:147 component=remote_write msg="Remote writing" timestamp=2022-05-05T10:59:57.974Z total_series=8 level=debug ts=2022-05-05T11:00:12.986Z caller=remote_write.go:147 component=remote_write msg="Remote writing" timestamp=2022-05-05T11:00:12.974Z total_series=8 level=info ts=2022-05-05T11:00:16.285Z caller=server.go:102 component=alertsServer msg="Received alerts" num_alerts=1 level=debug ts=2022-05-05T11:00:27.975Z caller=remote_write.go:147 component=remote_write msg="Remote writing" timestamp=2022-05-05T11:00:27.974Z total_series=8 level=info ts=2022-05-05T11:00:29.811Z caller=server.go:102 component=alertsServer msg="Received alerts" num_alerts=1 level=info ts=2022-05-05T11:00:29.815Z caller=server.go:102 component=alertsServer msg="Received alerts" num_alerts=1 level=info ts=2022-05-05T11:00:39.132Z caller=server.go:102 component=alertsServer msg="Received alerts" num_alerts=2 level=info ts=2022-05-05T11:00:39.172Z caller=server.go:102 component=alertsServer msg="Received alerts" num_alerts=1 level=debug ts=2022-05-05T11:00:42.977Z caller=remote_write.go:147 component=remote_write msg="Remote writing" timestamp=2022-05-05T11:00:42.974Z total_series=8 level=debug ts=2022-05-05T11:00:57.977Z caller=remote_write.go:147 component=remote_write msg="Remote writing" timestamp=2022-05-05T11:00:57.974Z total_series=8 level=info ts=2022-05-05T11:01:09.130Z caller=server.go:102 component=alertsServer msg="Received alerts" num_alerts=1 level=info ts=2022-05-05T11:01:09.167Z caller=server.go:102 component=alertsServer msg="Received alerts" num_alerts=1 level=debug ts=2022-05-05T11:01:12.974Z caller=remote_write.go:147 component=remote_write msg="Remote writing" timestamp=2022-05-05T11:01:12.974Z total_series=8 level=debug ts=2022-05-05T11:01:27.977Z caller=remote_write.go:147 component=remote_write msg="Remote writing" timestamp=2022-05-05T11:01:27.974Z total_series=8 level=debug ts=2022-05-05T11:01:42.986Z caller=remote_write.go:147 component=remote_write msg="Remote writing" timestamp=2022-05-05T11:01:42.974Z total_series=8 level=info ts=2022-05-05T11:01:46.284Z caller=server.go:102 component=alertsServer msg="Received alerts" num_alerts=1 level=debug ts=2022-05-05T11:01:57.975Z caller=remote_write.go:147 component=remote_write msg="Remote writing" timestamp=2022-05-05T11:01:57.974Z total_series=8 level=info ts=2022-05-05T11:01:59.810Z caller=server.go:102 component=alertsServer msg="Received alerts" num_alerts=1 level=info ts=2022-05-05T11:01:59.814Z caller=server.go:102 component=alertsServer msg="Received alerts" num_alerts=1 level=info ts=2022-05-05T11:02:09.131Z caller=server.go:102 component=alertsServer msg="Received alerts" num_alerts=1 level=debug ts=2022-05-05T11:02:12.975Z caller=remote_write.go:147 component=remote_write msg="Remote writing" timestamp=2022-05-05T11:02:12.974Z total_series=8 level=info ts=2022-05-05T11:02:16.283Z caller=server.go:102 component=alertsServer msg="Received alerts" num_alerts=1 level=debug ts=2022-05-05T11:02:27.974Z caller=remote_write.go:147 component=remote_write msg="Remote writing" timestamp=2022-05-05T11:02:27.974Z total_series=8 level=info ts=2022-05-05T11:02:39.133Z caller=server.go:102 component=alertsServer msg="Received alerts" num_alerts=1 level=info ts=2022-05-05T11:02:39.169Z caller=server.go:102 component=alertsServer msg="Received alerts" num_alerts=1 level=debug ts=2022-05-05T11:02:42.977Z caller=remote_write.go:147 component=remote_write msg="Remote writing" timestamp=2022-05-05T11:02:42.974Z total_series=8 level=debug ts=2022-05-05T11:02:57.975Z caller=remote_write.go:147 component=remote_write msg="Remote writing" timestamp=2022-05-05T11:02:57.974Z total_series=8 level=info ts=2022-05-05T11:03:09.131Z caller=server.go:102 component=alertsServer msg="Received alerts" num_alerts=1 level=debug ts=2022-05-05T11:03:12.977Z caller=remote_write.go:147 component=remote_write msg="Remote writing" timestamp=2022-05-05T11:03:12.974Z total_series=8 level=debug ts=2022-05-05T11:03:27.981Z caller=remote_write.go:147 component=remote_write msg="Remote writing" timestamp=2022-05-05T11:03:27.974Z total_series=8 level=info ts=2022-05-05T11:03:29.811Z caller=server.go:102 component=alertsServer msg="Received alerts" num_alerts=1 level=info ts=2022-05-05T11:03:29.814Z caller=server.go:102 component=alertsServer msg="Received alerts" num_alerts=1 level=debug ts=2022-05-05T11:03:42.977Z caller=remote_write.go:147 component=remote_write msg="Remote writing" timestamp=2022-05-05T11:03:42.974Z total_series=8 level=info ts=2022-05-05T11:03:46.283Z caller=server.go:102 component=alertsServer msg="Received alerts" num_alerts=1 level=debug ts=2022-05-05T11:03:57.975Z caller=remote_write.go:147 component=remote_write msg="Remote writing" timestamp=2022-05-05T11:03:57.974Z total_series=8 level=info ts=2022-05-05T11:04:09.130Z caller=server.go:102 component=alertsServer msg="Received alerts" num_alerts=1 level=info ts=2022-05-05T11:04:09.143Z caller=server.go:102 component=alertsServer msg="Received alerts" num_alerts=1 level=debug ts=2022-05-05T11:04:12.975Z caller=remote_write.go:147 component=remote_write msg="Remote writing" timestamp=2022-05-05T11:04:12.974Z total_series=8 level=debug ts=2022-05-05T11:04:27.977Z caller=remote_write.go:147 component=remote_write msg="Remote writing" timestamp=2022-05-05T11:04:27.974Z total_series=8 level=info ts=2022-05-05T11:04:39.132Z caller=server.go:102 component=alertsServer msg="Received alerts" num_alerts=1 level=debug ts=2022-05-05T11:04:42.977Z caller=remote_write.go:147 component=remote_write msg="Remote writing" timestamp=2022-05-05T11:04:42.974Z total_series=8 level=debug ts=2022-05-05T11:04:57.978Z caller=remote_write.go:147 component=remote_write msg="Remote writing" timestamp=2022-05-05T11:04:57.974Z total_series=8 level=info ts=2022-05-05T11:04:59.811Z caller=server.go:102 component=alertsServer msg="Received alerts" num_alerts=1 level=info ts=2022-05-05T11:04:59.815Z caller=server.go:102 component=alertsServer msg="Received alerts" num_alerts=1 level=debug ts=2022-05-05T11:05:12.977Z caller=remote_write.go:147 component=remote_write msg="Remote writing" timestamp=2022-05-05T11:05:12.974Z total_series=8 level=info ts=2022-05-05T11:05:16.284Z caller=server.go:102 component=alertsServer msg="Received alerts" num_alerts=1 level=debug ts=2022-05-05T11:05:27.975Z caller=remote_write.go:147 component=remote_write msg="Remote writing" timestamp=2022-05-05T11:05:27.974Z total_series=8 level=info ts=2022-05-05T11:05:39.130Z caller=server.go:102 component=alertsServer msg="Received alerts" num_alerts=1 level=info ts=2022-05-05T11:05:39.141Z caller=server.go:102 component=alertsServer msg="Received alerts" num_alerts=1 level=debug ts=2022-05-05T11:05:42.977Z caller=remote_write.go:147 component=remote_write msg="Remote writing" timestamp=2022-05-05T11:05:42.974Z total_series=8 level=debug ts=2022-05-05T11:05:57.978Z caller=remote_write.go:147 component=remote_write msg="Remote writing" timestamp=2022-05-05T11:05:57.974Z total_series=8 level=info ts=2022-05-05T11:06:09.130Z caller=server.go:102 component=alertsServer msg="Received alerts" num_alerts=1 level=debug ts=2022-05-05T11:06:12.977Z caller=remote_write.go:147 component=remote_write msg="Remote writing" timestamp=2022-05-05T11:06:12.974Z total_series=7 level=debug ts=2022-05-05T11:06:27.981Z caller=remote_write.go:147 component=remote_write msg="Remote writing" timestamp=2022-05-05T11:06:27.974Z total_series=7 level=debug ts=2022-05-05T11:06:42.987Z caller=remote_write.go:147 component=remote_write msg="Remote writing" timestamp=2022-05-05T11:06:42.974Z total_series=7 level=info ts=2022-05-05T11:06:46.284Z caller=server.go:102 component=alertsServer msg="Received alerts" num_alerts=1 level=debug ts=2022-05-05T11:06:57.974Z caller=remote_write.go:147 component=remote_write msg="Remote writing" timestamp=2022-05-05T11:06:57.974Z total_series=7 level=info ts=2022-05-05T11:07:09.132Z caller=server.go:102 component=alertsServer msg="Received alerts" num_alerts=1 level=info ts=2022-05-05T11:07:09.144Z caller=server.go:102 component=alertsServer msg="Received alerts" num_alerts=1 level=debug ts=2022-05-05T11:07:12.977Z caller=remote_write.go:147 component=remote_write msg="Remote writing" timestamp=2022-05-05T11:07:12.974Z total_series=7 level=debug ts=2022-05-05T11:07:27.977Z caller=remote_write.go:147 component=remote_write msg="Remote writing" timestamp=2022-05-05T11:07:27.974Z total_series=7 level=info ts=2022-05-05T11:07:39.129Z caller=server.go:102 component=alertsServer msg="Received alerts" num_alerts=1 level=debug ts=2022-05-05T11:07:42.977Z caller=remote_write.go:147 component=remote_write msg="Remote writing" timestamp=2022-05-05T11:07:42.974Z total_series=7 level=debug ts=2022-05-05T11:07:57.978Z caller=remote_write.go:147 component=remote_write msg="Remote writing" timestamp=2022-05-05T11:07:57.974Z total_series=7 level=info ts=2022-05-05T11:07:59.817Z caller=server.go:102 component=alertsServer msg="Received alerts" num_alerts=1 level=debug ts=2022-05-05T11:08:12.977Z caller=remote_write.go:147 component=remote_write msg="Remote writing" timestamp=2022-05-05T11:08:12.974Z total_series=6 level=info ts=2022-05-05T11:08:20.801Z caller=testsuite.go:384 component=testsuite msg="Test finished successfully for a rule group" rulegroup=NewAlerts_OrderCheck level=debug ts=2022-05-05T11:08:27.981Z caller=remote_write.go:147 component=remote_write msg="Remote writing" timestamp=2022-05-05T11:08:27.974Z total_series=6 level=info ts=2022-05-05T11:08:39.131Z caller=server.go:102 component=alertsServer msg="Received alerts" num_alerts=1 level=info ts=2022-05-05T11:08:39.142Z caller=server.go:102 component=alertsServer msg="Received alerts" num_alerts=1 level=debug ts=2022-05-05T11:08:42.978Z caller=remote_write.go:147 component=remote_write msg="Remote writing" timestamp=2022-05-05T11:08:42.974Z total_series=6 level=debug ts=2022-05-05T11:08:57.980Z caller=remote_write.go:147 component=remote_write msg="Remote writing" timestamp=2022-05-05T11:08:57.974Z total_series=6 level=info ts=2022-05-05T11:09:09.132Z caller=server.go:102 component=alertsServer msg="Received alerts" num_alerts=1 level=debug ts=2022-05-05T11:09:12.975Z caller=remote_write.go:147 component=remote_write msg="Remote writing" timestamp=2022-05-05T11:09:12.974Z total_series=6 level=debug ts=2022-05-05T11:09:27.981Z caller=remote_write.go:147 component=remote_write msg="Remote writing" timestamp=2022-05-05T11:09:27.974Z total_series=6 level=info ts=2022-05-05T11:09:29.813Z caller=server.go:102 component=alertsServer msg="Received alerts" num_alerts=1 level=debug ts=2022-05-05T11:09:42.977Z caller=remote_write.go:147 component=remote_write msg="Remote writing" timestamp=2022-05-05T11:09:42.974Z total_series=6 level=debug ts=2022-05-05T11:09:57.981Z caller=remote_write.go:147 component=remote_write msg="Remote writing" timestamp=2022-05-05T11:09:57.974Z total_series=6 level=info ts=2022-05-05T11:10:09.130Z caller=server.go:102 component=alertsServer msg="Received alerts" num_alerts=1 level=info ts=2022-05-05T11:10:09.140Z caller=server.go:102 component=alertsServer msg="Received alerts" num_alerts=1 level=debug ts=2022-05-05T11:10:12.977Z caller=remote_write.go:147 component=remote_write msg="Remote writing" timestamp=2022-05-05T11:10:12.974Z total_series=6 level=debug ts=2022-05-05T11:10:27.979Z caller=remote_write.go:147 component=remote_write msg="Remote writing" timestamp=2022-05-05T11:10:27.974Z total_series=6 level=info ts=2022-05-05T11:10:39.132Z caller=server.go:102 component=alertsServer msg="Received alerts" num_alerts=1 level=debug ts=2022-05-05T11:10:42.978Z caller=remote_write.go:147 component=remote_write msg="Remote writing" timestamp=2022-05-05T11:10:42.974Z total_series=6 level=debug ts=2022-05-05T11:10:57.978Z caller=remote_write.go:147 component=remote_write msg="Remote writing" timestamp=2022-05-05T11:10:57.974Z total_series=6 level=info ts=2022-05-05T11:10:59.815Z caller=server.go:102 component=alertsServer msg="Received alerts" num_alerts=1 level=debug ts=2022-05-05T11:11:12.978Z caller=remote_write.go:147 component=remote_write msg="Remote writing" timestamp=2022-05-05T11:11:12.974Z total_series=6 level=debug ts=2022-05-05T11:11:27.977Z caller=remote_write.go:147 component=remote_write msg="Remote writing" timestamp=2022-05-05T11:11:27.974Z total_series=4 level=info ts=2022-05-05T11:11:29.807Z caller=server.go:102 component=alertsServer msg="Received alerts" num_alerts=1 level=info ts=2022-05-05T11:11:39.131Z caller=server.go:102 component=alertsServer msg="Received alerts" num_alerts=1 level=info ts=2022-05-05T11:11:39.143Z caller=server.go:102 component=alertsServer msg="Received alerts" num_alerts=1 level=debug ts=2022-05-05T11:11:42.978Z caller=remote_write.go:147 component=remote_write msg="Remote writing" timestamp=2022-05-05T11:11:42.974Z total_series=4 level=debug ts=2022-05-05T11:11:57.977Z caller=remote_write.go:147 component=remote_write msg="Remote writing" timestamp=2022-05-05T11:11:57.974Z total_series=4 level=info ts=2022-05-05T11:12:09.125Z caller=server.go:102 component=alertsServer msg="Received alerts" num_alerts=1 level=debug ts=2022-05-05T11:12:12.975Z caller=remote_write.go:147 component=remote_write msg="Remote writing" timestamp=2022-05-05T11:12:12.974Z total_series=4 level=debug ts=2022-05-05T11:12:27.981Z caller=remote_write.go:147 component=remote_write msg="Remote writing" timestamp=2022-05-05T11:12:27.974Z total_series=4 level=debug ts=2022-05-05T11:12:42.988Z caller=remote_write.go:147 component=remote_write msg="Remote writing" timestamp=2022-05-05T11:12:42.974Z total_series=4 level=debug ts=2022-05-05T11:12:57.978Z caller=remote_write.go:147 component=remote_write msg="Remote writing" timestamp=2022-05-05T11:12:57.974Z total_series=4 level=info ts=2022-05-05T11:12:59.810Z caller=server.go:102 component=alertsServer msg="Received alerts" num_alerts=1 level=info ts=2022-05-05T11:13:09.129Z caller=server.go:102 component=alertsServer msg="Received alerts" num_alerts=1 level=info ts=2022-05-05T11:13:09.140Z caller=server.go:102 component=alertsServer msg="Received alerts" num_alerts=1 level=debug ts=2022-05-05T11:13:12.977Z caller=remote_write.go:147 component=remote_write msg="Remote writing" timestamp=2022-05-05T11:13:12.974Z total_series=4 level=info ts=2022-05-05T11:13:16.278Z caller=server.go:102 component=alertsServer msg="Received alerts" num_alerts=1 level=debug ts=2022-05-05T11:13:27.975Z caller=remote_write.go:147 component=remote_write msg="Remote writing" timestamp=2022-05-05T11:13:27.974Z total_series=4 level=info ts=2022-05-05T11:13:39.132Z caller=server.go:102 component=alertsServer msg="Received alerts" num_alerts=1 level=debug ts=2022-05-05T11:13:42.975Z caller=remote_write.go:147 component=remote_write msg="Remote writing" timestamp=2022-05-05T11:13:42.974Z total_series=4 level=debug ts=2022-05-05T11:13:57.977Z caller=remote_write.go:147 component=remote_write msg="Remote writing" timestamp=2022-05-05T11:13:57.974Z total_series=4 level=debug ts=2022-05-05T11:14:12.985Z caller=remote_write.go:147 component=remote_write msg="Remote writing" timestamp=2022-05-05T11:14:12.974Z total_series=4 level=debug ts=2022-05-05T11:14:27.981Z caller=remote_write.go:147 component=remote_write msg="Remote writing" timestamp=2022-05-05T11:14:27.974Z total_series=4 level=info ts=2022-05-05T11:14:29.811Z caller=server.go:102 component=alertsServer msg="Received alerts" num_alerts=1 level=info ts=2022-05-05T11:14:39.128Z caller=server.go:102 component=alertsServer msg="Received alerts" num_alerts=1 level=info ts=2022-05-05T11:14:39.134Z caller=server.go:102 component=alertsServer msg="Received alerts" num_alerts=1 level=debug ts=2022-05-05T11:14:42.977Z caller=remote_write.go:147 component=remote_write msg="Remote writing" timestamp=2022-05-05T11:14:42.974Z total_series=4 level=info ts=2022-05-05T11:14:46.285Z caller=server.go:102 component=alertsServer msg="Received alerts" num_alerts=1 level=debug ts=2022-05-05T11:14:57.975Z caller=remote_write.go:147 component=remote_write msg="Remote writing" timestamp=2022-05-05T11:14:57.974Z total_series=4 level=info ts=2022-05-05T11:15:09.131Z caller=server.go:102 component=alertsServer msg="Received alerts" num_alerts=1 level=debug ts=2022-05-05T11:15:12.977Z caller=remote_write.go:147 component=remote_write msg="Remote writing" timestamp=2022-05-05T11:15:12.974Z total_series=4 level=debug ts=2022-05-05T11:15:27.977Z caller=remote_write.go:147 component=remote_write msg="Remote writing" timestamp=2022-05-05T11:15:27.974Z total_series=4 level=debug ts=2022-05-05T11:15:42.985Z caller=remote_write.go:147 component=remote_write msg="Remote writing" timestamp=2022-05-05T11:15:42.974Z total_series=4 level=debug ts=2022-05-05T11:15:57.977Z caller=remote_write.go:147 component=remote_write msg="Remote writing" timestamp=2022-05-05T11:15:57.974Z total_series=4 level=info ts=2022-05-05T11:15:59.810Z caller=server.go:102 component=alertsServer msg="Received alerts" num_alerts=1 level=info ts=2022-05-05T11:16:09.130Z caller=server.go:102 component=alertsServer msg="Received alerts" num_alerts=1 level=info ts=2022-05-05T11:16:09.144Z caller=server.go:102 component=alertsServer msg="Received alerts" num_alerts=1 level=debug ts=2022-05-05T11:16:12.977Z caller=remote_write.go:147 component=remote_write msg="Remote writing" timestamp=2022-05-05T11:16:12.974Z total_series=4 level=info ts=2022-05-05T11:16:16.283Z caller=server.go:102 component=alertsServer msg="Received alerts" num_alerts=1 level=debug ts=2022-05-05T11:16:27.975Z caller=remote_write.go:147 component=remote_write msg="Remote writing" timestamp=2022-05-05T11:16:27.974Z total_series=4 level=info ts=2022-05-05T11:16:39.129Z caller=server.go:102 component=alertsServer msg="Received alerts" num_alerts=1 level=debug ts=2022-05-05T11:16:42.977Z caller=remote_write.go:147 component=remote_write msg="Remote writing" timestamp=2022-05-05T11:16:42.974Z total_series=4 level=info ts=2022-05-05T11:16:50.836Z caller=testsuite.go:384 component=testsuite msg="Test finished successfully for a rule group" rulegroup=ZeroFor_SmallFor level=debug ts=2022-05-05T11:16:57.978Z caller=remote_write.go:147 component=remote_write msg="Remote writing" timestamp=2022-05-05T11:16:57.974Z total_series=4 level=debug ts=2022-05-05T11:17:12.989Z caller=remote_write.go:147 component=remote_write msg="Remote writing" timestamp=2022-05-05T11:17:12.974Z total_series=4 level=debug ts=2022-05-05T11:17:27.980Z caller=remote_write.go:147 component=remote_write msg="Remote writing" timestamp=2022-05-05T11:17:27.974Z total_series=4 level=info ts=2022-05-05T11:17:29.808Z caller=server.go:102 component=alertsServer msg="Received alerts" num_alerts=1 level=debug ts=2022-05-05T11:17:42.978Z caller=remote_write.go:147 component=remote_write msg="Remote writing" timestamp=2022-05-05T11:17:42.974Z total_series=4 level=info ts=2022-05-05T11:17:46.284Z caller=server.go:102 component=alertsServer msg="Received alerts" num_alerts=1 level=debug ts=2022-05-05T11:17:57.976Z caller=remote_write.go:147 component=remote_write msg="Remote writing" timestamp=2022-05-05T11:17:57.974Z total_series=4 level=info ts=2022-05-05T11:18:09.131Z caller=server.go:102 component=alertsServer msg="Received alerts" num_alerts=1 level=debug ts=2022-05-05T11:18:12.977Z caller=remote_write.go:147 component=remote_write msg="Remote writing" timestamp=2022-05-05T11:18:12.974Z total_series=4 level=info ts=2022-05-05T11:18:16.283Z caller=server.go:102 component=alertsServer msg="Received alerts" num_alerts=1 level=debug ts=2022-05-05T11:18:27.975Z caller=remote_write.go:147 component=remote_write msg="Remote writing" timestamp=2022-05-05T11:18:27.974Z total_series=4 level=debug ts=2022-05-05T11:18:42.986Z caller=remote_write.go:147 component=remote_write msg="Remote writing" timestamp=2022-05-05T11:18:42.974Z total_series=4 level=debug ts=2022-05-05T11:18:57.981Z caller=remote_write.go:147 component=remote_write msg="Remote writing" timestamp=2022-05-05T11:18:57.974Z total_series=4 level=info ts=2022-05-05T11:18:59.812Z caller=server.go:102 component=alertsServer msg="Received alerts" num_alerts=1 level=debug ts=2022-05-05T11:19:12.975Z caller=remote_write.go:147 component=remote_write msg="Remote writing" timestamp=2022-05-05T11:19:12.974Z total_series=4 level=debug ts=2022-05-05T11:19:27.979Z caller=remote_write.go:147 component=remote_write msg="Remote writing" timestamp=2022-05-05T11:19:27.974Z total_series=4 level=debug ts=2022-05-05T11:19:42.986Z caller=remote_write.go:147 component=remote_write msg="Remote writing" timestamp=2022-05-05T11:19:42.974Z total_series=4 level=info ts=2022-05-05T11:19:46.283Z caller=server.go:102 component=alertsServer msg="Received alerts" num_alerts=1 level=debug ts=2022-05-05T11:19:57.976Z caller=remote_write.go:147 component=remote_write msg="Remote writing" timestamp=2022-05-05T11:19:57.974Z total_series=4 level=debug ts=2022-05-05T11:20:12.983Z caller=remote_write.go:147 component=remote_write msg="Remote writing" timestamp=2022-05-05T11:20:12.974Z total_series=4 level=debug ts=2022-05-05T11:20:27.979Z caller=remote_write.go:147 component=remote_write msg="Remote writing" timestamp=2022-05-05T11:20:27.974Z total_series=4 level=info ts=2022-05-05T11:20:29.808Z caller=server.go:102 component=alertsServer msg="Received alerts" num_alerts=1 level=debug ts=2022-05-05T11:20:42.975Z caller=remote_write.go:147 component=remote_write msg="Remote writing" timestamp=2022-05-05T11:20:42.974Z total_series=4 level=debug ts=2022-05-05T11:20:57.981Z caller=remote_write.go:147 component=remote_write msg="Remote writing" timestamp=2022-05-05T11:20:57.974Z total_series=4 level=debug ts=2022-05-05T11:21:12.986Z caller=remote_write.go:147 component=remote_write msg="Remote writing" timestamp=2022-05-05T11:21:12.974Z total_series=4 level=info ts=2022-05-05T11:21:16.284Z caller=server.go:102 component=alertsServer msg="Received alerts" num_alerts=1 level=debug ts=2022-05-05T11:21:27.975Z caller=remote_write.go:147 component=remote_write msg="Remote writing" timestamp=2022-05-05T11:21:27.974Z total_series=4 level=debug ts=2022-05-05T11:21:42.974Z caller=remote_write.go:147 component=remote_write msg="Remote writing" timestamp=2022-05-05T11:21:42.974Z total_series=4 level=debug ts=2022-05-05T11:21:57.977Z caller=remote_write.go:147 component=remote_write msg="Remote writing" timestamp=2022-05-05T11:21:57.974Z total_series=4 level=info ts=2022-05-05T11:21:59.811Z caller=server.go:102 component=alertsServer msg="Received alerts" num_alerts=1 level=debug ts=2022-05-05T11:22:12.975Z caller=remote_write.go:147 component=remote_write msg="Remote writing" timestamp=2022-05-05T11:22:12.974Z total_series=3 level=info ts=2022-05-05T11:22:20.867Z caller=testsuite.go:384 component=testsuite msg="Test finished successfully for a rule group" rulegroup=PendingAndFiringAndResolved Congrats! All tests passed
