On 8/1/2012 10:35 AM, Walter Bright wrote:
I suggest proposing the D lexer as an addition to Phobos. But if that is done, its interface would need to accept a range as input, and its output should be a range of tokens.
See the thread over in digitalmars.D about a proposed std.d.lexer.