lexer works fine, problem is in happy parser.

2010/10/26 Stephen Tetley <stephen.tet...@gmail.com>

> Hello
>
> I would change you Alex specification to this:
>
> $digit = 0-9                    -- digits
> $alpha = [a-zA-Z]               -- alphabetic characters
> $eol = [\r\n]
> $any = [^$eol]
>
> tokens :-
>
>  $eol               { tok $ \_ -> Eol }
>  $any+              { tok $ \s -> Str s }
>
>
> The complementation operator (^) works of character sets so I don't
> expect your original formulation to work:
>
> $any = [^\r\n]
>
> (maybe it should, but I never liked the Alex syntax...)
>
> You can test alex scanners like this:
>
> demo01 = alexScanTokens "happy?\n"
> demo02 = readFile "sample" >>= print . alexScanTokens
>
> Note - your sample file is using extended characters so it fails for
> me with Alex 2.3.2. I'm now sure how capable the current version of
> Alex is or whether better Unicode support can be enabled with flags.
>
> Regards
>
> Stephen
> _______________________________________________
> Haskell-Cafe mailing list
> Haskell-Cafe@haskell.org
> http://www.haskell.org/mailman/listinfo/haskell-cafe
>
_______________________________________________
Haskell-Cafe mailing list
Haskell-Cafe@haskell.org
http://www.haskell.org/mailman/listinfo/haskell-cafe

Reply via email to