Issue 87642
Summary lit - test failures on LLVM 18.x on windows.
Labels test-suite, llvm-lit
Assignees jdenny-ornl
Reporter tru
    I see the following LIT tests fail with LLVM 18 on Windows:

```
15:52:00   lit :: per-test-coverage-by-lit-cfg.py
15:52:00   lit :: per-test-coverage.py
15:52:00   lit :: shtest-external-shell-kill.py
15:52:00   lit :: shtest-format.py
15:52:00   lit :: shtest-run-at-line.py
```

This is the output for per-test-coverage.py:

```
FAIL: lit :: per-test-coverage.py (1 of 1)
******************** TEST 'lit :: per-test-coverage.py' FAILED ********************
Exit Code: 1

Command Output (stdout):
--
# RUN: at line 3
env -u FILECHECK_OPTS "c:\code\llvm\llvm.packageci\build\python-env\Scripts\python.exe" C:\code\llvm\llvm.packageci\git\llvm-project\llvm\utils\lit\lit.py -j1 --order=lexical -a -vv --per-test-coverage -Dexecute_external=False Inputs/per-test-coverage/per-test-coverage.py |    FileCheck -DOUT=stdout C:\code\llvm\llvm.packageci\build\llvm-final-windows\utils\lit\tests\per-test-coverage.py
# executed command: env -u FILECHECK_OPTS 'c:\code\llvm\llvm.packageci\build\python-env\Scripts\python.exe' 'C:\code\llvm\llvm.packageci\git\llvm-project\llvm\utils\lit\lit.py' -j1 --order=lexical -a -vv --per-test-coverage -Dexecute_external=False Inputs/per-test-coverage/per-test-coverage.py
# executed command: FileCheck -DOUT=stdout 'C:\code\llvm\llvm.packageci\build\llvm-final-windows\utils\lit\tests\per-test-coverage.py'
# RUN: at line 7
env -u FILECHECK_OPTS "c:\code\llvm\llvm.packageci\build\python-env\Scripts\python.exe" C:\code\llvm\llvm.packageci\git\llvm-project\llvm\utils\lit\lit.py -j1 --order=lexical -a -vv --per-test-coverage -Dexecute_external=True Inputs/per-test-coverage/per-test-coverage.py |    FileCheck -DOUT=stderr C:\code\llvm\llvm.packageci\build\llvm-final-windows\utils\lit\tests\per-test-coverage.py
# executed command: env -u FILECHECK_OPTS 'c:\code\llvm\llvm.packageci\build\python-env\Scripts\python.exe' 'C:\code\llvm\llvm.packageci\git\llvm-project\llvm\utils\lit\lit.py' -j1 --order=lexical -a -vv --per-test-coverage -Dexecute_external=True Inputs/per-test-coverage/per-test-coverage.py
# .---command stderr------------
# | lit.py: C:\code\llvm\llvm.packageci\git\llvm-project\llvm\utils\lit\lit\LitConfig.py:181: note: bash command failed: "c:\windows\system32\bash.exe" "-c" "[[ -f "c:\\windows\\system32\\bash.exe" ]]"
# | lit.py: C:\code\llvm\llvm.packageci\git\llvm-project\llvm\utils\lit\lit\LitConfig.py:187: warning: Unable to find a usable version of bash.
# `-----------------------------
# error: command failed with exit status: 1
# executed command: FileCheck -DOUT=stderr 'C:\code\llvm\llvm.packageci\build\llvm-final-windows\utils\lit\tests\per-test-coverage.py'
# .---command stderr------------
# | C:\code\llvm\llvm.packageci\build\llvm-final-windows\utils\lit\tests\per-test-coverage.py:11:10: error: CHECK: expected string not found in input
# | # CHECK: {{^}}PASS: per-test-coverage :: per-test-coverage.py ({{[^)]*}})
# |          ^
# | <stdin>:1:1: note: scanning from here
# | -- Testing: 1 tests, 1 workers --
# | ^
# | <stdin>:2:1: note: possible intended match here
# | FAIL: per-test-coverage :: per-test-coverage.py (1 of 1)
# | ^
# |
# | Input file: <stdin>
# | Check file: C:\code\llvm\llvm.packageci\build\llvm-final-windows\utils\lit\tests\per-test-coverage.py
# |
# | -dump-input=help explains the following input dump.
# |
# | Input was:
# | <<<<<<
# |             1: -- Testing: 1 tests, 1 workers --
# | check:11'0     X~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ error: no match found
# |             2: FAIL: per-test-coverage :: per-test-coverage.py (1 of 1)
# | check:11'0 ~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~
# | check:11'1 ?                                                         possible intended match
# |             3: ******************** TEST 'per-test-coverage :: per-test-coverage.py' FAILED ********************
# | check:11'0 ~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~
# |             4: Exit Code: 255
# | check:11'0     ~~~~~~~~~~~~~~~
# | 5:
# | check:11'0     ~
# |             6: Command Output (stdout):
# | check:11'0     ~~~~~~~~~~~~~~~~~~~~~~~~~
# | 7: --
# | check:11'0     ~~~
# |             .
# | .
# |             .
# | >>>>>>
# `-----------------------------
# error: command failed with exit status: 1
--
```

The other test failures looks similar. I know you did some work around this recently @jdenny-ornl - was the test not updated correctly ? I checked main as well but didn't see any changes in the test itself, but maybe I am missing something else in the setup?


_______________________________________________
llvm-bugs mailing list
[email protected]
https://lists.llvm.org/cgi-bin/mailman/listinfo/llvm-bugs

Reply via email to