This adds the capability to do fuzzy comparison of stddev output from
tiny_psnr. The current decoder tests compare against 0 because they use
use decoded output as the reference rather than original pre-encoded
audio. So, to be able to compare against a reference value, I changed it
from a <= comparison to an absolute difference comparison. The reason
for checking both higher and lower values is that we want to be aware
of any significant quality changes. If the quality goes up we will want
to change the reference so that future changes do not decrease quality
back to the previous level without a FATE failure.
Thanks,
Justin
Justin Ruggles (6):
FATE: do not pass $fuzz around in fate-run.sh
FATE: make do_tiny_psnr() use absolute difference from a target value
FATE: make size comparison optional in do_tiny_psnr()
FATE: add capability for audio encode/decode tests with fuzzy psnr
comparison
FATE: add WMAv1 and WMAv2 encode/decode tests with fuzzy comparison
FATE: add AC-3 and E-AC-3 encode/decode tests with fuzzy comparison
tests/Makefile | 2 +-
tests/fate-run.sh | 37 +++++++++++++++++++++++++++++--------
tests/fate/ac3.mak | 12 ++++++++++++
tests/fate/wma.mak | 15 +++++++++++++++
tests/ref/fate/ac3-encode | 1 +
tests/ref/fate/eac3-encode | 1 +
tests/ref/fate/wmav1-encode | 1 +
tests/ref/fate/wmav2-encode | 1 +
8 files changed, 61 insertions(+), 9 deletions(-)
create mode 100644 tests/ref/fate/ac3-encode
create mode 100644 tests/ref/fate/eac3-encode
create mode 100644 tests/ref/fate/wmav1-encode
create mode 100644 tests/ref/fate/wmav2-encode
_______________________________________________
libav-devel mailing list
[email protected]
https://lists.libav.org/mailman/listinfo/libav-devel
