Update on the alert generator compliance: Some vendors cannot expose some of the APIs required by the Prometheus alert generator compliance test suite.
*We modified the test suite so it can be run by vendors themselves and submit results to Prometheus/CNCF. *CNCF will contractually protect against submitting wrong results on purpose. If there are any questions, please feel free to ask in this thread. Thanks, Jean-Philippe Quéméner (johnnyqqqq) On Friday, May 6, 2022 at 10:51:07 AM UTC+2 hark...@timescale.com wrote: > Hello everyone, > > I have run the alert-generator compliance test on Promscale and I am happy > to report that *Promscale passed the test with a score of 100%*. Please > find the logs of the alert generator attached to this message. > > I will open a PR on prometheus/compliance > <https://github.com/prometheus/compliance> shortly, with instructions on > how to run the alert-generator compliance test on Promscale. > > Thank you > Harkishen > > Promscale version: 0.11-alpha > Promscale recent commit: link > <https://github.com/timescale/promscale/commit/1c8efecc9b7a5d6fcf025dba58017e17f2194c2a> > TimescaleDB image: > ghcr.io/timescale/dev_promscale_extension:0.5.0-alpha-ts2-pg14 > > *Note:* The above image is a pre-release. While opening the PR in the > prometheus/compliance repository, I will use the stable version which will > be ready soon. > > *Links* > Promscale: https://github.com/timescale/promscale > Alert-generator compliance: > https://github.com/prometheus/compliance/tree/main/alert_generator > > On Wednesday, March 2, 2022 at 2:12:02 PM UTC+5:30 ganes...@gmail.com > wrote: > >> Hello Promscale team, >> >> I hope this email finds you well. >> >> As a part of Prometheus conformance program >> <https://github.com/cncf/prometheus-conformance>, we had floated a doc >> on "Prometheus Alert-Generator Compliance" many months ago and had >> finalized the specification for that (see here >> <https://github.com/prometheus/compliance/blob/main/alert_generator/specification.md> >> ). >> >> The test suite to test the specification is now ready and instructions on >> how to run the test suite are present here >> <https://github.com/prometheus/compliance/blob/main/alert_generator/README.md> >> . >> >> If you wish Promscale to be compliant with Prometheus Alert-Generator, >> please test your software with the above test suite and report back the >> results by replying to this thread (results being the entire log output of >> the test run). >> >> If you do need any additional help from the test suite (for example >> setting custom headers to some requests), please let me know and I will add >> those abilities to the test suite. >> >> Going forward, we would like to automate this process. We ask you to add >> your test-suite config template by opening a PR against >> prometheus/compliance <https://github.com/prometheus/compliance/> and >> create test-promscale.yaml in the alert_generator directory. See >> test-.*.yaml files here >> <https://github.com/prometheus/compliance/tree/main/alert_generator> for >> example. Please also add instructions on how to set up as comments in the >> same file. >> >> If you face issues in running the test suite or understanding any error >> messages, I am happy to answer your queries. >> >> We plan to publish the results during the third week of May 2022 (during >> KubeCon EU). >> >> Thanks, >> Ganesh (codesome) >> Prometheus team >> > -- You received this message because you are subscribed to the Google Groups "Prometheus Developers" group. To unsubscribe from this group and stop receiving emails from it, send an email to prometheus-developers+unsubscr...@googlegroups.com. To view this discussion on the web visit https://groups.google.com/d/msgid/prometheus-developers/02b774a2-a926-4122-9829-2d0313890b86n%40googlegroups.com.
