On Fri, 29 Aug 2014 13:41:20 +0000 Mike James via Digitalmars-d-learn <[email protected]> wrote:
> Looking at the DMD Source Guide it says "The lexer transforms the > file into an array of tokens." > > Why is this step taken instead of, say, just calling a function > that returns the next token (or however many required for the > look-ahead)? D parser is somewhat complicated and it can peek alot of tokens from input stream without consuming 'em. so it's just easier to convert source code to tokens and then work with token stream.
signature.asc
Description: PGP signature
