Hi,

During tokenization, we atomize identifiers. This makes sense to me,
because identifiers are almost certain to appear multiple times.

But we also atomize string literals. These are much less likely to
appear multiple times. Is it necessary?

A more general question: what exactly is atomization for? Is it purely
for cases where we want to avoid duplicating strings (with the option
of interning)? The fact that lots of data structures (e.g. ParseNode)
have JSAtom* fields suggests that it's not this simple. This is
something I've never entirely got my head around.

Thanks.

Nick
_______________________________________________
dev-tech-js-engine-internals mailing list
[email protected]
https://lists.mozilla.org/listinfo/dev-tech-js-engine-internals

Reply via email to