i had my first encounter with the testsuite, and i thought you
might be interested in first-encounter notes (platform: win/xp,
cygwin shell, mingw gcc):-)
- why do i need to install python to run haskell tests? isn't
haskell good enough (dogfood and all that..)?
- when the testsuite is pulled late in the game, and python
installed for it, one needs to rerun configure?
- the usage documentation page is only online. it should be
copied into the download, for offline users.
- following the online docs, one soon gets a testrun
started, only to find that the output isn't recorded
anywhere, so it all has just flushed down stdout!
full testrun targets should record their output in
tests.log or some such file (and can it be that 'make
distclean' deleted my test-orig.log file that i kept for
comparison with after-patch results?).
- i get 1 unexpected pass and 14 unexpected failures
before my patches, which seems rather a lot, but all but
four of them appear in recent windows head buildbot
logs, so i guess that is accepted? (and yes, i did rm -rf
libraries/bytestring; ./darcs-all get).
the four unexpected unexpected failures are
utf8_00[2345], all of which look like this:
-utf8_005.hs:2:0: lexical error (UTF-8 decoding error)
+utf8_005.hs:2:0: lexical error at end of input ]
---------------------------------
OVERALL SUMMARY for test run started at Wed Sep 5 13:37:38 GMTDT 2007
1948 total tests, which gave rise to
10228 test cases, of which
0 caused framework failures
8612 were skipped
1551 expected passes
49 expected failures
1 unexpected passes
15 unexpected failures
Unexpected passes:
hReady001(normal)
Unexpected failures:
ThreadDelay001(normal)
break011(ghci)
break020(ghci)
break021(ghci)
bytestring001(normal)
bytestring004(normal)
bytestring005(normal)
cabal01(normal)
cabal01prof(normal)
conc068(normal) -- since fixed (EnterCriticalSection..)
hist001(ghci)
utf8_002(normal)
utf8_003(normal)
utf8_004(normal)
utf8_005(normal)
---------------------------------
- it takes a lot more that 5 minutes to run
'make -C testsuite/tests/ghc-regress/ fast stage=2'
on a 2Ghz Pentium M760. and when i first started
running the tests, from within that directory, i was
surprised to see tests outside that directory being
run (such as libraries/network/tests)
- libraries/network/net00[12] ran into my firewall, and
since i had not expected them, nor could find them
in the test directory (see above), i blocked them.
not that that stopped the testsuite in any way, so
it took me a while to reassure myself that these
were run as part of the testsuite, but it is strange
that the blocking does not affect them..
claus
_______________________________________________
Cvs-ghc mailing list
[email protected]
http://www.haskell.org/mailman/listinfo/cvs-ghc
