I can't point you to any reading but my PEG parser generator works (and requires) a separate tokenizing stage (it just, personally, made more sense to me). The tokenizer is built in, but it was designed to allow an external tokenizer. (Generates only Java code though).

Matthew

On 11/05/19 10:01 AM, Juancarlo Añez wrote:
Hello,

Please point me to the reading list for making PEG work when there's an existing and required tokenizer?

Thanks in advance, and regards,

--
Juancarlo *Añez*

_______________________________________________
PEG mailing list
PEG@lists.csail.mit.edu
https://lists.csail.mit.edu/mailman/listinfo/peg
_______________________________________________
PEG mailing list
PEG@lists.csail.mit.edu
https://lists.csail.mit.edu/mailman/listinfo/peg

Reply via email to