Hello all,

Why do some tests in the testdata/tokenizer/ directory contain things
like CRs and null bytes? Shouldn't the input stream preprocessor (which
I'm assuming is distinct from tokenization, since it's not in section
8.2.4) handle these things?

Cheers,
Edward

--~--~---------~--~----~------------~-------~--~----~
You received this message because you are subscribed to the Google Groups 
"html5lib-discuss" group.
 To post to this group, send email to [email protected]
 To unsubscribe from this group, send email to 
[email protected]
 For more options, visit this group at 
http://groups.google.com/group/html5lib-discuss?hl=en-GB
-~----------~----~----~----~------~----~------~--~---

Reply via email to