Re: RISC-V Test Errors and Failures

[Vineet Gupta]

On 5/16/23 16:06, Palmer Dabbelt wrote:
A few of us were talking about test-related issues in the patchwork 
meeting
this morning.  I bumped to trunk and did a full rebuild, I'm getting the
following (it's in riscv-systems-ci/riscv-gnu-toolchain).  This is 
about what I
remember seeing last time I ran the tests, which was a week or so ago.  I
figured it'd be best to just blast the lists, as Jeff said his test 
running had
been hanging so there might be some issue preventing folks from seeing 
the
failures.
I guess I didn't get time to look last time and I doubt things are 
looking any
better right now.  I'll try and take a look at some point, but any 
help would
of course be appreciated.

Yes I was seeing similar tcl errors and such - and in my case an even 
higher count.
Also for posterity, what was your configure cmdline ? multilibs or no
We really need to add some CI around RV toolchains to trip on these sooner !


$ cat toolchain/report
make[1]: Entering directory '/scratch/merges/rgt-gcc-trunk/toolchain'
/scratch/merges/rgt-gcc-trunk/riscv-gnu-toolchain/scripts/testsuite-filter 
gcc glibc 
/scratch/merges/rgt-gcc-trunk/riscv-gnu-toolchain/test/allowlist `find 
build-gcc-linux-stage2/gcc/testsuite/ -name *.sum |paste -sd "," -`
        === g++: Unexpected fails for rv64imac lp64 medlow ===
FAIL: g++.dg/contracts/contracts-tmpl-spec2.C   output pattern test
        === g++: Unexpected fails for rv32imac ilp32 medlow ===
FAIL: g++.dg/contracts/contracts-tmpl-spec2.C   output pattern test
FAIL: g++.dg/modules/xtreme-header-5_c.C -std=c++2a (test for excess 
errors)
FAIL: g++.dg/modules/xtreme-header-5_c.C -std=c++2b (test for excess 
errors)
        === g++: Unexpected fails for rv64imafdc lp64d medlow ===
FAIL: g++.dg/contracts/contracts-tmpl-spec2.C   output pattern test
        === g++: Unexpected fails for rv32imafdc ilp32d medlow ===
FAIL: g++.dg/contracts/contracts-tmpl-spec2.C   output pattern test
FAIL: g++.dg/modules/xtreme-header-5_c.C -std=c++2a (test for excess 
errors)
FAIL: g++.dg/modules/xtreme-header-5_c.C -std=c++2b (test for excess 
errors)
        === g++: Unexpected fails for rv64imafdcv lp64d  ===
FAIL: g++.dg/contracts/contracts-tmpl-spec2.C   output pattern test
FAIL: g++.target/riscv/rvv/base/bug-10.C execution test
FAIL: g++.target/riscv/rvv/base/bug-11.C execution test
FAIL: g++.target/riscv/rvv/base/bug-12.C execution test
FAIL: g++.target/riscv/rvv/base/bug-13.C execution test
FAIL: g++.target/riscv/rvv/base/bug-14.C execution test
FAIL: g++.target/riscv/rvv/base/bug-15.C execution test
FAIL: g++.target/riscv/rvv/base/bug-16.C execution test
FAIL: g++.target/riscv/rvv/base/bug-17.C execution test
FAIL: g++.target/riscv/rvv/base/bug-2.C execution test
FAIL: g++.target/riscv/rvv/base/bug-23.C execution test
FAIL: g++.target/riscv/rvv/base/bug-3.C execution test
FAIL: g++.target/riscv/rvv/base/bug-4.C execution test
FAIL: g++.target/riscv/rvv/base/bug-5.C execution test
FAIL: g++.target/riscv/rvv/base/bug-6.C execution test
FAIL: g++.target/riscv/rvv/base/bug-7.C execution test
FAIL: g++.target/riscv/rvv/base/bug-8.C execution test
FAIL: g++.target/riscv/rvv/base/bug-9.C execution test
        === g++: Unexpected fails for rv32imafdcv ilp32d  ===
FAIL: g++.dg/contracts/contracts-tmpl-spec2.C   output pattern test
FAIL: g++.dg/modules/xtreme-header-5_c.C -std=c++2a (test for excess 
errors)
FAIL: g++.dg/modules/xtreme-header-5_c.C -std=c++2b (test for excess 
errors)
FAIL: g++.target/riscv/rvv/base/bug-10.C execution test
FAIL: g++.target/riscv/rvv/base/bug-11.C execution test
FAIL: g++.target/riscv/rvv/base/bug-12.C execution test
FAIL: g++.target/riscv/rvv/base/bug-13.C execution test
FAIL: g++.target/riscv/rvv/base/bug-14.C (test for excess errors)
FAIL: g++.target/riscv/rvv/base/bug-15.C execution test
FAIL: g++.target/riscv/rvv/base/bug-16.C execution test
FAIL: g++.target/riscv/rvv/base/bug-17.C execution test
FAIL: g++.target/riscv/rvv/base/bug-18.C (test for excess errors)
FAIL: g++.target/riscv/rvv/base/bug-19.C (test for excess errors)
FAIL: g++.target/riscv/rvv/base/bug-2.C execution test
FAIL: g++.target/riscv/rvv/base/bug-20.C (test for excess errors)
FAIL: g++.target/riscv/rvv/base/bug-21.C (test for excess errors)
FAIL: g++.target/riscv/rvv/base/bug-22.C (test for excess errors)
FAIL: g++.target/riscv/rvv/base/bug-23.C execution test
FAIL: g++.target/riscv/rvv/base/bug-3.C execution test
FAIL: g++.target/riscv/rvv/base/bug-4.C execution test
FAIL: g++.target/riscv/rvv/base/bug-5.C execution test
FAIL: g++.target/riscv/rvv/base/bug-6.C execution test
FAIL: g++.target/riscv/rvv/base/bug-7.C execution test
FAIL: g++.target/riscv/rvv/base/bug-8.C execution test
FAIL: g++.target/riscv/rvv/base/bug-9.C (test for excess errors)
        === g++: Unexpected fails for rv64gczba_zbb_zbc_zbs lp64d ===
FAIL: g++.dg/contracts/contracts-tmpl-spec2.C   output pattern test
        === gcc: Unexpected fails for rv64imac lp64 medlow ===
ERROR: tcl error sourcing 
/scratch/merges/rgt-gcc-trunk/riscv-gnu-toolchain/gcc/gcc/testsuite/gcc.c-torture/execute/builtins/builtins.exp.
ERROR: torture-init: torture_without_loops is not empty as expected
ERROR: tcl error sourcing 
/scratch/merges/rgt-gcc-trunk/riscv-gnu-toolchain/gcc/gcc/testsuite/gcc.c-torture/execute/ieee/ieee.exp.
ERROR: torture-init: torture_without_loops is not empty as expected
ERROR: tcl error sourcing 
/scratch/merges/rgt-gcc-trunk/riscv-gnu-toolchain/gcc/gcc/testsuite/gcc.c-torture/unsorted/unsorted.exp.
ERROR: torture-init: torture_without_loops is not empty as expected
XPASS: gcc.dg/uninit-pr101912.c pr101912 (test for bogus messages, 
line 14)
ERROR: tcl error sourcing 
/scratch/merges/rgt-gcc-trunk/riscv-gnu-toolchain/gcc/gcc/testsuite/gcc.dg/format/format.exp.
ERROR: torture-init: torture_without_loops is not empty as expected
ERROR: tcl error sourcing 
/scratch/merges/rgt-gcc-trunk/riscv-gnu-toolchain/gcc/gcc/testsuite/gcc.dg/guality/guality.exp.
ERROR: torture-init: torture_without_loops is not empty as expected
ERROR: tcl error sourcing 
/scratch/merges/rgt-gcc-trunk/riscv-gnu-toolchain/gcc/gcc/testsuite/gcc.dg/pch/pch.exp.
ERROR: torture-init: torture_without_loops is not empty as expected
ERROR: tcl error sourcing 
/scratch/merges/rgt-gcc-trunk/riscv-gnu-toolchain/gcc/gcc/testsuite/gcc.dg/sancov/sancov.exp.
ERROR: torture-init: torture_without_loops is not empty as expected
ERROR: tcl error sourcing 
/scratch/merges/rgt-gcc-trunk/riscv-gnu-toolchain/gcc/gcc/testsuite/gcc.dg/simulate-thread/simulate-thread.exp.
ERROR: torture-init: torture_without_loops is not empty as expected
ERROR: tcl error sourcing 
/scratch/merges/rgt-gcc-trunk/riscv-gnu-toolchain/gcc/gcc/testsuite/gcc.dg/sso/sso.exp.
ERROR: torture-init: torture_without_loops is not empty as expected
ERROR: tcl error sourcing 
/scratch/merges/rgt-gcc-trunk/riscv-gnu-toolchain/gcc/gcc/testsuite/gcc.dg/torture/stackalign/stackalign.exp.
ERROR: torture-init: torture_without_loops is not empty as expected
ERROR: tcl error sourcing 
/scratch/merges/rgt-gcc-trunk/riscv-gnu-toolchain/gcc/gcc/testsuite/gcc.dg/torture/tls/tls.exp.
ERROR: torture-init: torture_without_loops is not empty as expected
ERROR: tcl error sourcing 
/scratch/merges/rgt-gcc-trunk/riscv-gnu-toolchain/gcc/gcc/testsuite/gcc.dg/tsan/tsan.exp.
ERROR: torture-init: torture_without_loops is not empty as expected
ERROR: tcl error sourcing 
/scratch/merges/rgt-gcc-trunk/riscv-gnu-toolchain/gcc/gcc/testsuite/gcc.misc-tests/i386-prefetch.exp.
ERROR: torture-init: torture_without_loops is not empty as expected
        === gcc: Unexpected fails for rv32imac ilp32 medlow ===
XPASS: gcc.dg/uninit-pr101912.c pr101912 (test for bogus messages, 
line 14)
        === gcc: Unexpected fails for rv64imafdc lp64d medlow ===
ERROR: tcl error sourcing 
/scratch/merges/rgt-gcc-trunk/riscv-gnu-toolchain/gcc/gcc/testsuite/gcc.c-torture/execute/builtins/builtins.exp.
ERROR: torture-init: torture_without_loops is not empty as expected
ERROR: tcl error sourcing 
/scratch/merges/rgt-gcc-trunk/riscv-gnu-toolchain/gcc/gcc/testsuite/gcc.c-torture/execute/ieee/ieee.exp.
ERROR: torture-init: torture_without_loops is not empty as expected
ERROR: tcl error sourcing 
/scratch/merges/rgt-gcc-trunk/riscv-gnu-toolchain/gcc/gcc/testsuite/gcc.c-torture/unsorted/unsorted.exp.
ERROR: torture-init: torture_without_loops is not empty as expected
XPASS: gcc.dg/uninit-pr101912.c pr101912 (test for bogus messages, 
line 14)
ERROR: tcl error sourcing 
/scratch/merges/rgt-gcc-trunk/riscv-gnu-toolchain/gcc/gcc/testsuite/gcc.dg/format/format.exp.
ERROR: torture-init: torture_without_loops is not empty as expected
ERROR: tcl error sourcing 
/scratch/merges/rgt-gcc-trunk/riscv-gnu-toolchain/gcc/gcc/testsuite/gcc.dg/guality/guality.exp.
ERROR: torture-init: torture_without_loops is not empty as expected
ERROR: tcl error sourcing 
/scratch/merges/rgt-gcc-trunk/riscv-gnu-toolchain/gcc/gcc/testsuite/gcc.dg/pch/pch.exp.
ERROR: torture-init: torture_without_loops is not empty as expected
ERROR: tcl error sourcing 
/scratch/merges/rgt-gcc-trunk/riscv-gnu-toolchain/gcc/gcc/testsuite/gcc.dg/sancov/sancov.exp.
ERROR: torture-init: torture_without_loops is not empty as expected
ERROR: tcl error sourcing 
/scratch/merges/rgt-gcc-trunk/riscv-gnu-toolchain/gcc/gcc/testsuite/gcc.dg/simulate-thread/simulate-thread.exp.
ERROR: torture-init: torture_without_loops is not empty as expected
ERROR: tcl error sourcing 
/scratch/merges/rgt-gcc-trunk/riscv-gnu-toolchain/gcc/gcc/testsuite/gcc.dg/sso/sso.exp.
ERROR: torture-init: torture_without_loops is not empty as expected
ERROR: tcl error sourcing 
/scratch/merges/rgt-gcc-trunk/riscv-gnu-toolchain/gcc/gcc/testsuite/gcc.dg/torture/stackalign/stackalign.exp.
ERROR: torture-init: torture_without_loops is not empty as expected
ERROR: tcl error sourcing 
/scratch/merges/rgt-gcc-trunk/riscv-gnu-toolchain/gcc/gcc/testsuite/gcc.dg/torture/tls/tls.exp.
ERROR: torture-init: torture_without_loops is not empty as expected
ERROR: tcl error sourcing 
/scratch/merges/rgt-gcc-trunk/riscv-gnu-toolchain/gcc/gcc/testsuite/gcc.dg/tsan/tsan.exp.
ERROR: torture-init: torture_without_loops is not empty as expected
ERROR: tcl error sourcing 
/scratch/merges/rgt-gcc-trunk/riscv-gnu-toolchain/gcc/gcc/testsuite/gcc.misc-tests/i386-prefetch.exp.
ERROR: torture-init: torture_without_loops is not empty as expected
        === gcc: Unexpected fails for rv32imafdc ilp32d medlow ===
ERROR: tcl error sourcing 
/scratch/merges/rgt-gcc-trunk/riscv-gnu-toolchain/gcc/gcc/testsuite/gcc.c-torture/execute/builtins/builtins.exp.
ERROR: torture-init: torture_without_loops is not empty as expected
ERROR: tcl error sourcing 
/scratch/merges/rgt-gcc-trunk/riscv-gnu-toolchain/gcc/gcc/testsuite/gcc.c-torture/execute/ieee/ieee.exp.
ERROR: torture-init: torture_without_loops is not empty as expected
ERROR: tcl error sourcing 
/scratch/merges/rgt-gcc-trunk/riscv-gnu-toolchain/gcc/gcc/testsuite/gcc.c-torture/unsorted/unsorted.exp.
ERROR: torture-init: torture_without_loops is not empty as expected
XPASS: gcc.dg/uninit-pr101912.c pr101912 (test for bogus messages, 
line 14)
ERROR: tcl error sourcing 
/scratch/merges/rgt-gcc-trunk/riscv-gnu-toolchain/gcc/gcc/testsuite/gcc.dg/format/format.exp.
ERROR: torture-init: torture_without_loops is not empty as expected
ERROR: tcl error sourcing 
/scratch/merges/rgt-gcc-trunk/riscv-gnu-toolchain/gcc/gcc/testsuite/gcc.dg/guality/guality.exp.
ERROR: torture-init: torture_without_loops is not empty as expected
ERROR: tcl error sourcing 
/scratch/merges/rgt-gcc-trunk/riscv-gnu-toolchain/gcc/gcc/testsuite/gcc.dg/pch/pch.exp.
ERROR: torture-init: torture_without_loops is not empty as expected
ERROR: tcl error sourcing 
/scratch/merges/rgt-gcc-trunk/riscv-gnu-toolchain/gcc/gcc/testsuite/gcc.dg/sancov/sancov.exp.
ERROR: torture-init: torture_without_loops is not empty as expected
ERROR: tcl error sourcing 
/scratch/merges/rgt-gcc-trunk/riscv-gnu-toolchain/gcc/gcc/testsuite/gcc.dg/simulate-thread/simulate-thread.exp.
ERROR: torture-init: torture_without_loops is not empty as expected
ERROR: tcl error sourcing 
/scratch/merges/rgt-gcc-trunk/riscv-gnu-toolchain/gcc/gcc/testsuite/gcc.dg/sso/sso.exp.
ERROR: torture-init: torture_without_loops is not empty as expected
ERROR: tcl error sourcing 
/scratch/merges/rgt-gcc-trunk/riscv-gnu-toolchain/gcc/gcc/testsuite/gcc.dg/torture/stackalign/stackalign.exp.
ERROR: torture-init: torture_without_loops is not empty as expected
ERROR: tcl error sourcing 
/scratch/merges/rgt-gcc-trunk/riscv-gnu-toolchain/gcc/gcc/testsuite/gcc.dg/torture/tls/tls.exp.
ERROR: torture-init: torture_without_loops is not empty as expected
ERROR: tcl error sourcing 
/scratch/merges/rgt-gcc-trunk/riscv-gnu-toolchain/gcc/gcc/testsuite/gcc.dg/tsan/tsan.exp.
ERROR: torture-init: torture_without_loops is not empty as expected
ERROR: tcl error sourcing 
/scratch/merges/rgt-gcc-trunk/riscv-gnu-toolchain/gcc/gcc/testsuite/gcc.misc-tests/i386-prefetch.exp.
ERROR: torture-init: torture_without_loops is not empty as expected
        === gcc: Unexpected fails for rv64imafdcv lp64d  ===
ERROR: tcl error sourcing 
/scratch/merges/rgt-gcc-trunk/riscv-gnu-toolchain/gcc/gcc/testsuite/gcc.c-torture/execute/builtins/builtins.exp.
ERROR: torture-init: torture_without_loops is not empty as expected
ERROR: tcl error sourcing 
/scratch/merges/rgt-gcc-trunk/riscv-gnu-toolchain/gcc/gcc/testsuite/gcc.c-torture/execute/ieee/ieee.exp.
ERROR: torture-init: torture_without_loops is not empty as expected
ERROR: tcl error sourcing 
/scratch/merges/rgt-gcc-trunk/riscv-gnu-toolchain/gcc/gcc/testsuite/gcc.c-torture/unsorted/unsorted.exp.
ERROR: torture-init: torture_without_loops is not empty as expected
XPASS: gcc.dg/uninit-pr101912.c pr101912 (test for bogus messages, 
line 14)
ERROR: tcl error sourcing 
/scratch/merges/rgt-gcc-trunk/riscv-gnu-toolchain/gcc/gcc/testsuite/gcc.dg/format/format.exp.
ERROR: torture-init: torture_without_loops is not empty as expected
ERROR: tcl error sourcing 
/scratch/merges/rgt-gcc-trunk/riscv-gnu-toolchain/gcc/gcc/testsuite/gcc.dg/guality/guality.exp.
ERROR: torture-init: torture_without_loops is not empty as expected
ERROR: tcl error sourcing 
/scratch/merges/rgt-gcc-trunk/riscv-gnu-toolchain/gcc/gcc/testsuite/gcc.dg/pch/pch.exp.
ERROR: torture-init: torture_without_loops is not empty as expected
ERROR: tcl error sourcing 
/scratch/merges/rgt-gcc-trunk/riscv-gnu-toolchain/gcc/gcc/testsuite/gcc.dg/sancov/sancov.exp.
ERROR: torture-init: torture_without_loops is not empty as expected
ERROR: tcl error sourcing 
/scratch/merges/rgt-gcc-trunk/riscv-gnu-toolchain/gcc/gcc/testsuite/gcc.dg/simulate-thread/simulate-thread.exp.
ERROR: torture-init: torture_without_loops is not empty as expected
ERROR: tcl error sourcing 
/scratch/merges/rgt-gcc-trunk/riscv-gnu-toolchain/gcc/gcc/testsuite/gcc.dg/sso/sso.exp.
ERROR: torture-init: torture_without_loops is not empty as expected
ERROR: tcl error sourcing 
/scratch/merges/rgt-gcc-trunk/riscv-gnu-toolchain/gcc/gcc/testsuite/gcc.dg/torture/stackalign/stackalign.exp.
ERROR: torture-init: torture_without_loops is not empty as expected
ERROR: tcl error sourcing 
/scratch/merges/rgt-gcc-trunk/riscv-gnu-toolchain/gcc/gcc/testsuite/gcc.dg/torture/tls/tls.exp.
ERROR: torture-init: torture_without_loops is not empty as expected
ERROR: tcl error sourcing 
/scratch/merges/rgt-gcc-trunk/riscv-gnu-toolchain/gcc/gcc/testsuite/gcc.dg/tsan/tsan.exp.
ERROR: torture-init: torture_without_loops is not empty as expected
ERROR: tcl error sourcing 
/scratch/merges/rgt-gcc-trunk/riscv-gnu-toolchain/gcc/gcc/testsuite/gcc.misc-tests/i386-prefetch.exp.
ERROR: torture-init: torture_without_loops is not empty as expected
FAIL: gcc.target/riscv/rvv/autovec/binop/shift-run.c execution test
FAIL: gcc.target/riscv/rvv/autovec/binop/shift-scalar-run.c execution 
test
FAIL: gcc.target/riscv/rvv/autovec/binop/vadd-run.c execution test
FAIL: gcc.target/riscv/rvv/autovec/binop/vand-run.c execution test
FAIL: gcc.target/riscv/rvv/autovec/binop/vdiv-run.c execution test
FAIL: gcc.target/riscv/rvv/autovec/binop/vmax-run.c execution test
FAIL: gcc.target/riscv/rvv/autovec/binop/vmin-run.c execution test
FAIL: gcc.target/riscv/rvv/autovec/binop/vmul-run.c execution test
FAIL: gcc.target/riscv/rvv/autovec/binop/vor-run.c execution test
FAIL: gcc.target/riscv/rvv/autovec/binop/vrem-run.c execution test
FAIL: gcc.target/riscv/rvv/autovec/binop/vsub-run.c execution test
FAIL: gcc.target/riscv/rvv/autovec/binop/vxor-run.c execution test
FAIL: gcc.target/riscv/rvv/autovec/partial/single_rgroup_run-1.c 
execution test
FAIL: gcc.target/riscv/rvv/autovec/series_run-1.c -O3 -ftree-vectorize 
execution test
FAIL: gcc.target/riscv/rvv/autovec/vls-vlmax/insert_run-1.c -std=c99 
-O3 -ftree-vectorize --param riscv-autovec-preference=fixed-vlmax 
execution test
FAIL: gcc.target/riscv/rvv/autovec/vls-vlmax/insert_run-2.c -std=c99 
-O3 -ftree-vectorize --param riscv-autovec-preference=fixed-vlmax 
execution test
FAIL: gcc.target/riscv/rvv/autovec/vls-vlmax/repeat_run-1.c -std=c99 
-O3 -ftree-vectorize --param riscv-autovec-preference=fixed-vlmax 
execution test
FAIL: gcc.target/riscv/rvv/autovec/vls-vlmax/repeat_run-2.c -std=c99 
-O3 -ftree-vectorize --param riscv-autovec-preference=fixed-vlmax 
execution test
FAIL: gcc.target/riscv/rvv/autovec/vls-vlmax/repeat_run-3.c -std=c99 
-O3 -ftree-vectorize --param riscv-autovec-preference=fixed-vlmax 
execution test
FAIL: gcc.target/riscv/rvv/autovec/vls-vlmax/repeat_run-4.c -std=c99 
-O3 -ftree-vectorize --param riscv-autovec-preference=fixed-vlmax 
execution test
FAIL: gcc.target/riscv/rvv/autovec/vls-vlmax/repeat_run-5.c -std=c99 
-O3 -ftree-vectorize --param riscv-autovec-preference=fixed-vlmax 
execution test
FAIL: gcc.target/riscv/rvv/autovec/vls-vlmax/repeat_run-6.c -std=c99 
-O3 -ftree-vectorize --param riscv-autovec-preference=fixed-vlmax 
execution test
FAIL: gcc.target/riscv/rvv/autovec/vmv-imm-run.c -O3 -ftree-vectorize 
(test for excess errors)
FAIL: gcc.target/riscv/rvv/base/bug-3.c execution test
FAIL: gcc.target/riscv/rvv/base/bug-4.c execution test
FAIL: gcc.target/riscv/rvv/base/bug-5.c execution test
        === gcc: Unexpected fails for rv32imafdcv ilp32d  ===
ERROR: tcl error sourcing 
/scratch/merges/rgt-gcc-trunk/riscv-gnu-toolchain/gcc/gcc/testsuite/gcc.c-torture/execute/builtins/builtins.exp.
ERROR: torture-init: torture_without_loops is not empty as expected
ERROR: tcl error sourcing 
/scratch/merges/rgt-gcc-trunk/riscv-gnu-toolchain/gcc/gcc/testsuite/gcc.c-torture/execute/ieee/ieee.exp.
ERROR: torture-init: torture_without_loops is not empty as expected
ERROR: tcl error sourcing 
/scratch/merges/rgt-gcc-trunk/riscv-gnu-toolchain/gcc/gcc/testsuite/gcc.c-torture/unsorted/unsorted.exp.
ERROR: torture-init: torture_without_loops is not empty as expected
XPASS: gcc.dg/uninit-pr101912.c pr101912 (test for bogus messages, 
line 14)
ERROR: tcl error sourcing 
/scratch/merges/rgt-gcc-trunk/riscv-gnu-toolchain/gcc/gcc/testsuite/gcc.dg/format/format.exp.
ERROR: torture-init: torture_without_loops is not empty as expected
ERROR: tcl error sourcing 
/scratch/merges/rgt-gcc-trunk/riscv-gnu-toolchain/gcc/gcc/testsuite/gcc.dg/guality/guality.exp.
ERROR: torture-init: torture_without_loops is not empty as expected
ERROR: tcl error sourcing 
/scratch/merges/rgt-gcc-trunk/riscv-gnu-toolchain/gcc/gcc/testsuite/gcc.dg/pch/pch.exp.
ERROR: torture-init: torture_without_loops is not empty as expected
ERROR: tcl error sourcing 
/scratch/merges/rgt-gcc-trunk/riscv-gnu-toolchain/gcc/gcc/testsuite/gcc.dg/sancov/sancov.exp.
ERROR: torture-init: torture_without_loops is not empty as expected
ERROR: tcl error sourcing 
/scratch/merges/rgt-gcc-trunk/riscv-gnu-toolchain/gcc/gcc/testsuite/gcc.dg/simulate-thread/simulate-thread.exp.
ERROR: torture-init: torture_without_loops is not empty as expected
ERROR: tcl error sourcing 
/scratch/merges/rgt-gcc-trunk/riscv-gnu-toolchain/gcc/gcc/testsuite/gcc.dg/sso/sso.exp.
ERROR: torture-init: torture_without_loops is not empty as expected
ERROR: tcl error sourcing 
/scratch/merges/rgt-gcc-trunk/riscv-gnu-toolchain/gcc/gcc/testsuite/gcc.dg/torture/stackalign/stackalign.exp.
ERROR: torture-init: torture_without_loops is not empty as expected
ERROR: tcl error sourcing 
/scratch/merges/rgt-gcc-trunk/riscv-gnu-toolchain/gcc/gcc/testsuite/gcc.dg/torture/tls/tls.exp.
ERROR: torture-init: torture_without_loops is not empty as expected
ERROR: tcl error sourcing 
/scratch/merges/rgt-gcc-trunk/riscv-gnu-toolchain/gcc/gcc/testsuite/gcc.dg/tsan/tsan.exp.
ERROR: torture-init: torture_without_loops is not empty as expected
ERROR: tcl error sourcing 
/scratch/merges/rgt-gcc-trunk/riscv-gnu-toolchain/gcc/gcc/testsuite/gcc.misc-tests/i386-prefetch.exp.
ERROR: torture-init: torture_without_loops is not empty as expected
FAIL: gcc.target/riscv/rvv/autovec/binop/shift-run.c execution test
FAIL: gcc.target/riscv/rvv/autovec/binop/shift-scalar-run.c execution 
test
FAIL: gcc.target/riscv/rvv/autovec/binop/vadd-run.c execution test
FAIL: gcc.target/riscv/rvv/autovec/binop/vand-run.c execution test
FAIL: gcc.target/riscv/rvv/autovec/binop/vdiv-run.c execution test
FAIL: gcc.target/riscv/rvv/autovec/binop/vmax-run.c execution test
FAIL: gcc.target/riscv/rvv/autovec/binop/vmin-run.c execution test
FAIL: gcc.target/riscv/rvv/autovec/binop/vmul-run.c execution test
FAIL: gcc.target/riscv/rvv/autovec/binop/vor-run.c execution test
FAIL: gcc.target/riscv/rvv/autovec/binop/vrem-run.c execution test
FAIL: gcc.target/riscv/rvv/autovec/binop/vsub-run.c execution test
FAIL: gcc.target/riscv/rvv/autovec/binop/vxor-run.c execution test
FAIL: gcc.target/riscv/rvv/autovec/partial/single_rgroup_run-1.c 
execution test
FAIL: gcc.target/riscv/rvv/autovec/series_run-1.c -O3 -ftree-vectorize 
execution test
FAIL: gcc.target/riscv/rvv/autovec/vls-vlmax/insert_run-1.c -std=c99 
-O3 -ftree-vectorize --param riscv-autovec-preference=fixed-vlmax 
execution test
FAIL: gcc.target/riscv/rvv/autovec/vls-vlmax/insert_run-2.c -std=c99 
-O3 -ftree-vectorize --param riscv-autovec-preference=fixed-vlmax 
execution test
FAIL: gcc.target/riscv/rvv/autovec/vls-vlmax/repeat_run-1.c -std=c99 
-O3 -ftree-vectorize --param riscv-autovec-preference=fixed-vlmax 
execution test
FAIL: gcc.target/riscv/rvv/autovec/vls-vlmax/repeat_run-2.c -std=c99 
-O3 -ftree-vectorize --param riscv-autovec-preference=fixed-vlmax 
execution test
FAIL: gcc.target/riscv/rvv/autovec/vls-vlmax/repeat_run-3.c -std=c99 
-O3 -ftree-vectorize --param riscv-autovec-preference=fixed-vlmax 
execution test
FAIL: gcc.target/riscv/rvv/autovec/vls-vlmax/repeat_run-4.c -std=c99 
-O3 -ftree-vectorize --param riscv-autovec-preference=fixed-vlmax 
execution test
FAIL: gcc.target/riscv/rvv/autovec/vls-vlmax/repeat_run-5.c -std=c99 
-O3 -ftree-vectorize --param riscv-autovec-preference=fixed-vlmax 
execution test
FAIL: gcc.target/riscv/rvv/autovec/vls-vlmax/repeat_run-6.c -std=c99 
-O3 -ftree-vectorize --param riscv-autovec-preference=fixed-vlmax 
execution test
FAIL: gcc.target/riscv/rvv/autovec/vmv-imm-run.c -O3 -ftree-vectorize 
(test for excess errors)
FAIL: gcc.target/riscv/rvv/base/bug-3.c execution test
FAIL: gcc.target/riscv/rvv/base/bug-4.c execution test
FAIL: gcc.target/riscv/rvv/base/bug-5.c execution test
        === gcc: Unexpected fails for rv64gczba_zbb_zbc_zbs lp64d ===
ERROR: tcl error sourcing 
/scratch/merges/rgt-gcc-trunk/riscv-gnu-toolchain/gcc/gcc/testsuite/gcc.c-torture/execute/builtins/builtins.exp.
ERROR: torture-init: torture_without_loops is not empty as expected
ERROR: tcl error sourcing 
/scratch/merges/rgt-gcc-trunk/riscv-gnu-toolchain/gcc/gcc/testsuite/gcc.c-torture/execute/ieee/ieee.exp.
ERROR: torture-init: torture_without_loops is not empty as expected
ERROR: tcl error sourcing 
/scratch/merges/rgt-gcc-trunk/riscv-gnu-toolchain/gcc/gcc/testsuite/gcc.c-torture/unsorted/unsorted.exp.
ERROR: torture-init: torture_without_loops is not empty as expected
FAIL: gcc.dg/optimize-bswapsi-1.c scan-tree-dump-times optimized "= 
__builtin_bswap32 \\(" 6
FAIL: gcc.dg/optimize-bswapsi-2.c scan-tree-dump-times bswap "32 bit 
bswap implementation found at" 4
FAIL: gcc.dg/optimize-bswapsi-3.c scan-tree-dump-times optimized "= 
__builtin_bswap32 \\(" 1
FAIL: gcc.dg/optimize-bswapsi-4.c scan-tree-dump bswap "32 bit bswap 
implementation found at"
FAIL: gcc.dg/optimize-bswapsi-5.c scan-tree-dump-times optimized "= 
__builtin_bswap32 \\(" 2
FAIL: gcc.dg/optimize-bswapsi-6.c scan-tree-dump store-merging "32 bit 
bswap implementation found at"
FAIL: gcc.dg/optimize-bswapsi-7.c scan-tree-dump-times optimized "= 
__builtin_bswap32 \\(" 4
XPASS: gcc.dg/uninit-pr101912.c pr101912 (test for bogus messages, 
line 14)
ERROR: tcl error sourcing 
/scratch/merges/rgt-gcc-trunk/riscv-gnu-toolchain/gcc/gcc/testsuite/gcc.dg/format/format.exp.
ERROR: torture-init: torture_without_loops is not empty as expected
ERROR: tcl error sourcing 
/scratch/merges/rgt-gcc-trunk/riscv-gnu-toolchain/gcc/gcc/testsuite/gcc.dg/guality/guality.exp.
ERROR: torture-init: torture_without_loops is not empty as expected
ERROR: tcl error sourcing 
/scratch/merges/rgt-gcc-trunk/riscv-gnu-toolchain/gcc/gcc/testsuite/gcc.dg/pch/pch.exp.
ERROR: torture-init: torture_without_loops is not empty as expected
ERROR: tcl error sourcing 
/scratch/merges/rgt-gcc-trunk/riscv-gnu-toolchain/gcc/gcc/testsuite/gcc.dg/sancov/sancov.exp.
ERROR: torture-init: torture_without_loops is not empty as expected
ERROR: tcl error sourcing 
/scratch/merges/rgt-gcc-trunk/riscv-gnu-toolchain/gcc/gcc/testsuite/gcc.dg/simulate-thread/simulate-thread.exp.
ERROR: torture-init: torture_without_loops is not empty as expected
ERROR: tcl error sourcing 
/scratch/merges/rgt-gcc-trunk/riscv-gnu-toolchain/gcc/gcc/testsuite/gcc.dg/sso/sso.exp.
ERROR: torture-init: torture_without_loops is not empty as expected
ERROR: tcl error sourcing 
/scratch/merges/rgt-gcc-trunk/riscv-gnu-toolchain/gcc/gcc/testsuite/gcc.dg/torture/stackalign/stackalign.exp.
ERROR: torture-init: torture_without_loops is not empty as expected
ERROR: tcl error sourcing 
/scratch/merges/rgt-gcc-trunk/riscv-gnu-toolchain/gcc/gcc/testsuite/gcc.dg/torture/tls/tls.exp.
ERROR: torture-init: torture_without_loops is not empty as expected
ERROR: tcl error sourcing 
/scratch/merges/rgt-gcc-trunk/riscv-gnu-toolchain/gcc/gcc/testsuite/gcc.dg/tsan/tsan.exp.
ERROR: torture-init: torture_without_loops is not empty as expected
ERROR: tcl error sourcing 
/scratch/merges/rgt-gcc-trunk/riscv-gnu-toolchain/gcc/gcc/testsuite/gcc.misc-tests/i386-prefetch.exp.
ERROR: torture-init: torture_without_loops is not empty as expected

              ========= Summary of gcc testsuite =========
                           | # of unexpected case / # of unique 
unexpected case
                           |          gcc |          g++ | gfortran |
rv32imafdc/ ilp32d/ medlow |  833 /     3 |    3 /     2 |    0 /     0 |
  rv32imac/  ilp32/ medlow |    1 /     1 |    3 /     2 |    0 /     0 |
rv32imafdcv/ ilp32d/        |  950 /    29 |   25 /    24 |    0 /     
0 |
rv64imafdcv/  lp64d/        |  950 /    29 |   18 /    18 |    0 /     
0 |
rv64imafdc/  lp64d/ medlow |  833 /     3 |    1 /     1 |    0 /     0 |
rv64gczba_zbb_zbc_zbs/  lp64d/        |  840 /    10 |    1 / 1 |    0 
/     0 |
  rv64imac/   lp64/ medlow |  833 /     3 |    1 /     1 |    0 /     0 |
make[1]: *** [Makefile:951: report-gcc-linux] Error 1
make[1]: Leaving directory '/scratch/merges/rgt-gcc-trunk/toolchain'