Daniel Fischer wrote:
Am Donnerstag, 26. Juni 2008 12:40 schrieb Eric:
What does the tokeniser return?
I would have to see more of the code to diagnose it.
Here is the code for the tokenizer:
type Scanner a = GenParser Char () a
data Token
= INum Integer | FNum Double
| Varid String | Reserved String
deriving (Show,Eq)
scan :: Scanner a -> Scanner(a, SourcePos)
scan p = do pos <- getPosition
x <- p
return(x,pos)
scan_integer, scan_varid, hreserved, htoken :: Scanner
(Token,SourcePos)
scan_integer = do (i,pos) <- scan(integer (makeTokenParser haskellDef))
return (INum i, pos)
scan_varid = do (c,pos) <- scan(hlower)
cs <- identifier(makeTokenParser haskellDef)
return (Varid (c:cs), pos)
hlower :: Scanner Char
hlower = lower <|> char '_'
hreserved = do (cs, pos) <- scan(string "(" <|> string ")")
return (Reserved cs,pos)
htoken = scan_integer <|> scan_varid <|> hreserved
scanall :: String -> [(Token,SourcePos)]
scanall cs = let result = parse (many htoken) "" cs
in case result of
Right tkns -> tkns
Left err -> error (show err)
E.
_______________________________________________
Haskell-Cafe mailing list
Haskell-Cafe@haskell.org
http://www.haskell.org/mailman/listinfo/haskell-cafe
