Hans-Peter Diettrich wrote:
Not necessarily. When all currently used files reside in memory, every
(recorded) token can contain an pointer (or offset) into the file
buffer. This may reduce the number of required string copies (not yet
fully researched).
You normally shouldn't ever need to process every token this way.
Language keywords are encoded with enumeration type. Everything else is put into hashtable, so you
typically need only as much string copies as there are distinct identifiers in the file. Besides,
shortstring copies are pretty cheap, compared to AnsiStrings.
Regards,
Sergei
_______________________________________________
fpc-devel maillist - fpc-devel@lists.freepascal.org
http://lists.freepascal.org/mailman/listinfo/fpc-devel
