On Wed, 11 Oct 2017, David Malcolm wrote:

On Wed, 2017-10-11 at 11:18 +0200, Paulo Matos wrote:

On 11/10/17 11:15, Christophe Lyon wrote:

You can have a look at
https://git.linaro.org/toolchain/gcc-compare-results.git/
where compare_tests is a patched version of the contrib/ script,
it calls the main perl script (which is not the prettiest thing :-)


Thanks, that's useful. I will take a look.

You may also want to look at this script I wrote:

 https://github.com/davidmalcolm/jamais-vu

(it has Python classes for working with DejaGnu output)

By the way, David, how do you handle comparisons for the jit testsuite? jv gives

Tests that went away in build/gcc/testsuite/jit/jit.sum: 81
-----------------------------------------------------------

 PASS:  t
 PASS:  test-
 PASS:  test-arith-overflow.c
 PASS:  test-arith-overflow.c.exe iteration 1 of 5: verify_uint_over
 PASS:  test-arith-overflow.c.exe iteration 2 of 5: verify_uint_o
 PASS:  test-arith-overflow.c.exe iteration 3 of 5: verify
[...]

Tests appeared in build/gcc/testsuite/jit/jit.sum: 78
-----------------------------------------------------

 PASS:  test-arith-overflow.c.exe iteration 1
 PASS:  test-arith-overflow.c.exe iteration 2 of
 PASS:  test-arith-overflow.c.exe iteration 4 of 5: verify_u
 PASS:  test-combination.
 PASS:  test-combination.c.exe it
[...]

The issue is more likely in the testsuite, but I assume you have a workflow that allows working around the issue?

--
Marc Glisse

Reply via email to