On Thursday, 2 August 2012 at 07:11:36 UTC, Jacob Carlborg wrote:
If you change Token to a struct it takes 64bytes on a LP64 platform. I don't know if that is too big to be passed around by value.
That's why I moved Token to a class in the first place. It became far too big and you had to pass it around by reference, which I thought defeated the purpose. https://github.com/bhelyer/std.d.lexer/ Gonna spend some time massaging this into a Walter-Approved (tm) lexer. It's got some ways to go.