10. High speed matters a lot
then add a benchmark "suite" to the list - the lexer should be benchmarked from the very first beginning
and it should be designed for multithreading - there is no need foron-the-fly hash-table updating - maybe just one update on each lex threads end