Hi, Python load tests/perf tests compute metrics and publish those metrics to Grafana for visualization.
As of now, there is no automated way of creating alerts(Github issues) when a performance regression is detected in the perf tests. I created a doc[1] which outlines an API to perform Change Point Analysis on the metric data computed by the python performance tests and how to file Github issues(alerts) when a performance regression is observed. Please take a look and let me know what you think. Any feedback would be appreciated. Thanks, Anand https://docs.google.com/document/d/1jhcmP405s5IRSB2T5ZlCAuBy8duhQjO0kgRLF0SfSl8/edit?usp=sharing
