While working on a project of mine recently I realized that a particular HUnit 
test should have been failing.  After paring things down, I came up with this 
shocker:


test_perhaps.hs:
module Main where
import Test.HUnit
main = runTestTT $ TestList [ True  ~=? True
                            , False ~=? True
                            , TestCase $ assertEqual "both true" True True
                            , TestCase $ assertEqual "false true" False True
                            ]

$ cabal-dev install
...
$ ./cabal-dev/bin/test_perhaps.hs
### Failure in: 3
false true
expected: False
 but got: True
Cases: 4  Tried: 4  Errors: 0  Failures: 1

The shock here is that there was only one failure, whereas the "False ~=? True" 
should have failed.
Environment: MacOS 10.5.8  (Leopard)
             GHC 6.12.3
             cabal-dev 0.7.4.1
             Cabal 1.10.1.0
             HUnit 1.2.2.3
I even tried removing the dist and cabal-dev directories and reattempting but 
got the same results.

I tried the same test in a different environment (Linux PC w/GHC 7.0.2, all 
other elements the same) and got correct results:

$ ./cabal-dev/bin/test_perhaps
### Failure in: 1
expected: False
 but got: True
### Failure in: 3
false true
expected: False
 but got: True
Cases: 4  Tried: 4  Errors: 0  Failures: 2
$

I realize it's very difficult to debug someone's setup remotely, but I have to confess 
I'm really stumped at this point.  The input program is pretty straightforward, and I 
*have* gotten test failures in the past on the Mac.  I did do a "cabal update" 
the other day after being informed that my hackage file was getting old, but HUnit hasn't 
changed in months.

I even tried unpacking HUnit and reducing the (non-)failing test case by using 
the definitions of the elements:


module Main where

import Control.Monad (unless)
import Test.HUnit

main = runTestTT $ TestList [ True  ~=? True
                            , False ~=? True
                            , TestCase $ assertEqual "both true" True True
                            , TestCase $ assertEqual "false true" False True
                            , TestCase $ assertEqual "fa" False True
                            , TestCase $ assertEqual "f" False True
                            , TestCase $ (False @?= True)
                            , TestCase $ unless (False == True) (assertFailure 
"f")
                            ]

The results are very strange:

$ ./cabal-dev/bin/test_perhaps
### Failure in: 3
false true
expected: False
 but got: True
### Failure in: 4
fa
expected: False
 but got: True
### Failure in: 7
f
Cases: 8  Tried: 8  Errors: 0  Failures: 3
$

The assertEqual form doesn't fail as it should if the label is a single 
character (test 5), but in its fully expanded form (test 7) it will fail.  Huh?!

At this point I'm thoroughly confused.  I'm using 6.12.3 on the Mac because I 
don't have the newer MacOS release for which there's a Haskell Platform release 
and I haven't wanted to build GHC by hand.  I wouldn't expect 6.12.3 to have 
issues like this, but I wouldn't expect issues like this anywhere.  If anyone 
has any suggestions (other than upgrading to GHC 7.x) I'll be most appreciative.

--
-KQ

_______________________________________________
Haskell-Cafe mailing list
[email protected]
http://www.haskell.org/mailman/listinfo/haskell-cafe

Reply via email to