Hello people watching the trending pages [0]. We have just merged a Change [1] which affects how MRR tests work. Instead of single trial of 10 second duration, the test is now executing 10 trials of 1 second.
PAL is told to aggregate the results, so in theory nothing should change, but in practice the anomaly detection could spot some regressions or progressions. If the anomalies are big, we will revert. If they are small (or none), we will tell PAL (next week) to take standard deviations into account, which will definitely make anomaly detection to mark many regressions and progressions (just because it is not easy to have the detection algorithm compatible with several trial durations at once). After that, the anomaly detection should be able to detect smaller regressions and progressions. If it starts detecting more noise than signal, we will revert (and try something else). Vratko. [0] https://docs.fd.io/csit/master/trending/introduction/dashboard.html [1] https://gerrit.fd.io/r/14596
-=-=-=-=-=-=-=-=-=-=-=- Links: You receive all messages sent to this group. View/Reply Online (#10457): https://lists.fd.io/g/vpp-dev/message/10457 Mute This Topic: https://lists.fd.io/mt/25500458/21656 Group Owner: vpp-dev+ow...@lists.fd.io Unsubscribe: https://lists.fd.io/g/vpp-dev/unsub [arch...@mail-archive.com] -=-=-=-=-=-=-=-=-=-=-=-
