Re: [PATCH 5/5] selftests/resctrl: Reduce failures due to outliers in MBA/MBM tests

2023-09-13 Thread Reinette Chatre
Hi Ilpo, On 9/13/2023 4:43 AM, Ilpo Järvinen wrote: > On Tue, 12 Sep 2023, Reinette Chatre wrote: >> On 9/11/2023 4:19 AM, Ilpo Järvinen wrote: >>> 5% difference upper bound for success is a bit on the low side for the >> >> "a bit on the low side" is very vague. > > The commit that introduced th

Re: [PATCH 5/5] selftests/resctrl: Reduce failures due to outliers in MBA/MBM tests

2023-09-13 Thread Ilpo Järvinen
On Tue, 12 Sep 2023, Reinette Chatre wrote: > On 9/11/2023 4:19 AM, Ilpo Järvinen wrote: > > 5% difference upper bound for success is a bit on the low side for the > > "a bit on the low side" is very vague. The commit that introduced that 5% bound plainly admitted it's "randomly chosen value". A

Re: [PATCH 5/5] selftests/resctrl: Reduce failures due to outliers in MBA/MBM tests

2023-09-12 Thread Reinette Chatre
Hi Ilpo, On 9/11/2023 4:19 AM, Ilpo Järvinen wrote: > 5% difference upper bound for success is a bit on the low side for the "a bit on the low side" is very vague. > MBA and MBM tests. Some platforms produce outliers that are slightly > above that, typically 6-7%. > > Relaxing the MBA/MBM succe

[PATCH 5/5] selftests/resctrl: Reduce failures due to outliers in MBA/MBM tests

2023-09-11 Thread Ilpo Järvinen
5% difference upper bound for success is a bit on the low side for the MBA and MBM tests. Some platforms produce outliers that are slightly above that, typically 6-7%. Relaxing the MBA/MBM success bound to 8% removes most of the failures due those frequent outliers. Fixes: 06bd03a57f8c ("selftest