I left some small comments, but overall this is a great proposal. I think
this should help fill a really important gap in our infrastructure and will
help make our perf dashboards actionable. Thanks for taking this on Anand!
On Wed, Nov 2, 2022 at 12:32 PM Anand Inguva via dev
wrote:
> Hi,
>
> Python load tests/perf tests compute metrics and publish those metrics to
> Grafana for visualization.
>
> As of now, there is no automated way of creating alerts(Github issues)
> when a performance regression is detected in the perf tests.
>
> I created a doc[1] which outlines an API to perform Change Point Analysis
> on the metric data computed by the python performance tests and how to file
> Github issues(alerts) when a performance regression is observed.
>
> Please take a look and let me know what you think. Any feedback would be
> appreciated.
>
> Thanks,
> Anand
>
>
> https://docs.google.com/document/d/1jhcmP405s5IRSB2T5ZlCAuBy8duhQjO0kgRLF0SfSl8/edit?usp=sharing
>
