Re: Perl's parser and lexer will likely be in Perl (was Re: RFC 334 (v1) I'm {STILL} trying to understand this...)

[Simon Cozens]

On Tue, Oct 17, 2000 at 11:22:02AM +0100, Nicholas Clark wrote:
> [Seriously, I was under the impression that the perl tokenizer was
> influenced by the state of the lexer]

Currently, the tokeniser and the lexer are a combined entity. It doesn't have
to be this way, though. At least, I don't think it does, until you're allowed
to define your own special variables which I sincerely hope won't happen.

(Quick, how would you parse "&%&%&%&%"?)

To be perfectly honest, my preferred solution would be to have the tokenizer,
lexer and parser as a single, hand-crafted LR(k) monstrosity.

-- 
"So i get the chance to reread my postings to asr at times, with a
corresponding conservation of the almighty leviam00se, Kai Henningsen."
        -- Megahal (trained on asr), 1998-11-06